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DISCLAIMERS 

The  findings  in  this  report  are  not  to  be  construed  as  an  official  US  Postal  Service  or 
Department  of  the  Navy  position,  unless  so  designated  by  other  authorized  documents. 

The  citation  of  trade  names  and  names  of  manufacturers  in  this  report  is  not  to  be 
construed  as  official  Government  indorsement  or  approval  of  commercial  products  or  serv- 
ices referenced  herein. 


OBJECTIVES 

1 . Provide  the  US  Postal  Service  the  technical  consultation,  equipment,  and  support 
services  which  will  contribute  to  the  development  of  the  system  definition  of  a new-concept 
processing  system,  the  Electronic  Message  Service  (EMS).  Include  in  the  scope  of  effort 

(1 ) investigations  in  scanner  technology,  image  frame  memory  storage,  and  image  enhance- 
ment, and  (2)  the  design  and  fabrication  of  a scanner/frame  store  memory  test  assembly. 

2.  Contribute  to  the  selection  of  the  most  optimum  imaging  devices  and  techniques 
for  high-speed  image  acquisition.  Provide  reliable  designs  of  high-speed  image  processing 
logic  which  will  preserve  the  quality  of  the  image  while  reducing  the  image  storage  and  trans- 
mission requirements  and  minimizing  vulnerability  of  the  image  information  to  noise  during 
processing,  transmission,  and  reproduction. 

3.  Act  as  technical  consultants  to  the  USPS  Office  of  Advanced  Mail  Systems 
Development  in  preparing  technical  requirements  and  statements  of  work  and  evaluating 
technical  proposals  and  contractor  performance;  and  perform  technical  evaluation  of 
contractor-produced  developmental  equipment. 
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RESULTS 

1.  A large  drum  test  bed  (LDTB)  was  designed  and  fabricated,  compatible  with 
Pitney  Bowes  paper  handling  equipment. 

2.  High-brightness  fluorescent  lamps  were  evaluated  for  use  in  the  LDTB  and  found 
to  be  superior,  for  this  application,  to  the  quartz  halogen  lamp  used  in  the  small  drum  test 
bed  that  was  developed  during  the  previous  year. 

3.  Software  was  developed  to  compensate  for  nonuniform  illumination. 

4.  Special  fluorescent  lamps  were  procured  in  which  the  mixture  of  phosphors  com- 
pensates for  falloff  in  imager  sensitivity  from  red  to  blue. 

5.  Test  and  evaluation  of  imagers  continued.  The  ranking  of  the  contenders  changed 
as  the  result  of  the  emergence  of  new  and  improved  devices. 

6.  New  CCD  driver  boards  incorporating  best  available  high-speed  logic  techniques 
were  designed  and  fabricated. 

7.  Image  analyzer  capability  was  expanded  so  that  first  derivative  and  run  length 
statistics  may  be  provided  in  addition  to  the  original  pel  brightness  statistics. 

8.  Progress  was  recorded  throughout  the  software  hierarchy  running  from  micro- 
codes up  to  high-level  procedural  programs.  Corresponding  hardware  improvements  were 
effected.  High-speed  PROMs  incorporating  microcode  data,  for  example,  replaced  the  low- 
speed  PROMs  previously  used  in  the  memory  controller. 

9.  Six  technical  reports  were  submitted  to  AMSD  in  the  reporting  period.  They  are 
included  here  as  appendixes. 

10.  A contract  was  issued  to  RCA  Princeton  for  the  development  of  a tracking/time- 
delay-integration  imager. 
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PLANNED  FUTURE  NELC  ACTIVITIES 

1 . Evaluate  new  imagers  that  may  be  suitable  for  EMS. 

2.  Continue  hardware  and  software  investigative  efforts  in  the  areas  of  buffers, 
coding,  compression,  enhancement,  processing,  and  analysis. 

3.  Evaluate  techniques  for  recreating  stored  images. 


ADMINISTRATIVE  INFORMATION 

This  report  contains  a summary  of  work  sponsored  by  the  Office  of  Advanced  Mail 
Systems  Development,  Planning  and  New  Development  Department  of  the  US  Postal  Ser- 
vice, Rockville,  Maryland  20852,  under  USPS/NELC  Agreement  104230-76-T-0798.  The 
contractual  period  was  10  October  1975  to  9 October  1976.  The  authorized  USPS  techni- 
cal representative  is  Victor  P Boyd.  The  principal  investigator  is  Frank  C Martin  of  the 
Display  Division,  NELC  Code  3 1 60.  Associate  investigators  are  Waldo  Robinson,  Tom 
Little,  Lee  Wise,  Joseph  Greene,  Clint  Mayo,  and  Bob  Basinger,  all  of  Code  3 1 60.  This  re- 
port is  a compilation  of  data  presented  by  d!l  team  members  and  was  approved  for  publi- 
cation October  1976. 
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GLOSSARY 


A/D 

Analog  to  digital 

ALRU 

Arithmetic  logic  register  unit 

ALU 

Arithmetic  logic  unit 

AMSD 

Office  of  Advanced  Mail  System  Development 

CCD 

Charge-coupled  device 

CPE 

Central  processing  element 

CRT 

Cathode  ray  tube 

D/A 

Digital  to  analog 

DIA 

Digital  image  analyzer 

EAROM 

Electrically  alterable  read  only  memory 

ECL 

Emitter  coupled  logic 

EMS 

Electronic  Message  Service 

FD  stats 

First  derivative  statistics 

Frame  store  memory 

The  3X10^  bit  memory  used  for  storing  imager  data  prior  to 
processing  and  image  storage  for  anything  displayed  on  the  high- 
resolution  monitor 

FSMC 

Frame  store  memory  controller,  the  primary  control  electronics 
for  the  test  bed 

GFE 

Government-furnished  equipment 

I2L 

Integrated  injection  logic 

Image  analyzer 

A module  of  electronics  circuitry  that  generates  the  FD,  PB,  or 
RL  statistics  according  to  wired  programs 

LDTB 

Large  drum  test  bed,  which  includes  the  40-inch  circumference 
drum,  drive  motors,  illumination  sources,  imager,  imaging  lens, 
imager  driver  board,  analog-to  digital  converter,  and  power  supplies 

LED 

Light  emitting  diode 

LSB 

Least  significant  bit 

LSI 

Large  scale  integration 

MARB 

Memory  address  register  bus 

MOS 

Metal  oxide  semiconductor 

MTBF 

Mean  time  between  failures 

NELC 

Naval  Electronics  Laboratory  Center 

PB  stats 

Pel  brightness  statistics 

Pel 

One  photosensitive  element  of  an  imaging  device 

PROM 

Programmable  read-only  memory 

RAM 

Random  access  memory 

RL  stats 

Run  length  statistics 
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ROM 

Read  only  memory 

SDB 

Secondary  data  bus 

SDTB 

Small  drum  test  bed,  which  includes  same  as  LDTB  except  for 
size  of  drum,  which  has  1 2-inch  circumference 

TDI 

Time  delay  integration 

Test  bed 

The  entire  complement  of  hardware  being  developed  by  NELC 
for  USPS 

TTL 

Transistor-transistor  logic 

USPS 

United  States  Postal  Service 

VTS 

Video  Transmission  System  (Navy) 

“WEBERVERT” 

Convert  from  linear  amplitude  steps  to  geometrically  propor- 
tional steps,  similar  to  but  in  larger  ratios  than  Weber’s  fraction 
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RELEVANCE  TO  DoD  MISSION 

If  instrumented,  the  Electronic  Message  Service  (EMS)  system  will  become  the  second- 
largest  communication  and  information  exchange  system  in  the  US.  Participation  on  the 
imaging  interface  aspects  of  the  system  provides  familiarity  for  our  Navy  group,  who  will  be 
able  to  assist  in  utilization  of  the  network  for  military  purposes  in  a time  of  national  need. 

The  actual  imaging  investigation  is  relevant  to  recent  and  current  NELC  programs 
such  as  DCA  facsimile  by  Codes  1400  and  3500,  the  Electro-Optical  Submarine  Mast  by 
Code  2500,  and  the  facsimile  programs  of  Code  3200.*  One  of  the  requirements  of  the 
Tactical  Flag  Command  Center  program  is  image  transmission.  Other  requirements  for  image 
acquisition,  processing,  and  transmission  are  implicated  in  work  for  the  Naval  Intelligence 
Support  Center.  The  USPS  test  bed  has  been  designed  to  interchange  data  with  the  NELC 
video  test  bed  in  Code  3140. 

One  of  the  program  procurements  is  a large,  high-speed  imaging,  charge-coupled 
device  (CCD)  which  can  operate  in  the  time-delay  integration  (TD1)  mode.  This  single 
device  is  capable  of  acquiring  full-page  data  at  a rate  of  20  pages  per  second.  The  high  per- 
formance of  the  device  makes  it  applicable  for  telereconnaissance,  teleguidance,  battlefield 
surveillance,  and  intrusion  detection  as  well  as  document  imaging. 

The  experience  gained  with  microprocessor  architecture,  image  processing,  high-speed 
storage  and  retrieval,  display,  and  hard-copy  generation  is  also  valuable  to  the  Navy.  There 
does  not  appear  to  be  much  image  processing  capability  within  DoD  activities  (outside  the 
intelligence  community).  ARPA  and  others  are  supporting  universities  which  are  doing 
excellent  image  processing  studies  in  software  programs  on  general-purpose  computers. 

Very  little  of  the  work  addresses  the  high-speed,  real-time  hardware  and  algorithm  require- 
ments of  military  applications. 


♦NELC  Code  1400 
3500 
2500 
3200 


Satellite  Systems  Program  Office 
Internal  Communications  and  Tech  Control  Division 
EO/Optics  Division 
Communications  Processing  Division 
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EMS  BACKGROUND 


Mall  has  long  been  a material  concept.  A “piece”  of  mail  is  a tangible  document, 
in  an  envelope,  with  another  material  thing,  a stamp,  pasted  on  the  envelope.  Mail  is 
“posted”  — dropped  into  a box.  It  is  “picked  up,”  “carried”  by  truck,  train,  or  plane, 
and  ultimately  “delivered.” 

Mail  of  this  familiar  variety  is  so  common  that  in  the  US  alone  billions  of  letters 
are  delivered  every  year,  and  the  number  is  growing.  The  load  is  monumental,  and  fleets 
of  planes  and  other  vehicles  and  armies  of  mailmen  are  hard  pressed  to  handle  it.  Demand 
for  reliable  service  and  rapid  delivery  adds  a dimension  to  the  problem. 

But  mail  has  another  aspect  which  is  not  physical.  Mail  is  intelligence,  and 
obviously  the  job  of  moving  the  mail  from  one  city  to  another  will  be  significantly 
lightened  when  it  can  be  reduced  to  moving  the  message,  divested  of  paper,  envelope,  and 
stamp. 

With  this  objective,  the  USPS  has  undertaken  the  investigation  of  advanced  mail 
systems.  An  important  element  in  this  program  is  the  investigation  of  a possible  Elec- 
tronic Message  Service  (EMS).  The  USPS  is  conducting  a detailed  system  definition  effort 
for  the  purpose  of  establishing  the  technical  and  economic  feasibility  of  a nationwide 
EMS  concept.  The  attractive  economics  of  available  wideband  telecommunications  sys- 
tems strongly  suggest  that  the  USPS  should  look  at  such  large-scale  message  systems  as  a 
new  means  of  providing  basic  message  services  at  reduced  costs  to  the  USPS  customer. 

Functionally,  EMS  would  accept  messages  in  digital  or  paper  copy  form,  convert 
inputs,  as  required,  into  digital  form,  transport  message  inputs  electronically  from  source 
to  EMS  destination  over  communication  networks,  and  either  convert  the  message  back 
to  paper  copy  form  for  carrier  delivery  to  the  recipient  or  deliver  it  to  the  customer  by 
alternative  electronic  delivery  systems. 

The  USPS  is  investigating  EMS  because  it  has  the  potential  capability  of  coping 
with  anticipated  changes  in  mail  volume  and  mail  patterns,  and  of  taking  advantage  of  the 
expanding  utilization  of  electronic  technology  within  the  business  world.  It  is  anticipated 
that  EMS  will  provide  the  customer  with  a faster,  more  reliable,  low-cost  service  and  that 
it  will  contribute  to  balancing  postal  costs  and  revenues  as  required  by  the  Postal  Reorga- 
nization Act. 


EMS  CONCEPTS 

To  provide  this  better  service,  the  Electronic  Message  Service  envisioned  by  the 
Postal  Service  would  be  set  up  as  a national  system  capable  of  processing  a tremendous 
volume  of  messages,  mostly  business-oriented.  Targeted  as  a possible  replacement  for 
first  class  mail  and  a partial  alternative  to  third  class,  the  system  would  be  a complex 
network  made  up  of  user  terminals,  stations,  and  centers  (see  figure  1). 

The  EMS  centers  would  interconnect  the  net  links,  performing  data  storing  and 
switching  tasks.  The  EMS  stations,  set  up  at  regional  post  offices  or  branches,  would 
contain  terminals  and  an  assortment  of  conversion  gear  - OCR  (optical  character  recogni- 
tion), microfiche  readers,  magnetic  tape  devices,  and  scanners  to  read  the  computer 
messages. 
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A customer  will  go  to  the  nearest  terminal  to  “post”  a letter.  The  message  input 
will  be  converted  to  compatible  digital  form  and  transmitted  electronically  to  its  destina- 
tion, probably  through  a mixed  hybrid  terrestrial  satellite  network.  At  its  destination, 
the  message  will  be  either  changed  back  to  paper  copy  form  for  hand  delivery  by  the 
postman,  or  delivered  electronically. 

It  is  evident  that  a critical  area  of  technology , for  a successful  EMS,  is  the  ability 
to  accept  and  convert  a customer  message  with  a very  high  degree  of  accuracy  across  a 
broad  range  of  input  documents.  A system  with  limited  input  range  or  very  restrictive 
format  would  severely  limit  the  potential  market.  Figure  2 shows  input  media  options 
for  the  EMS  concept. 

An  examination  of  the  figure  reveals  that  many  of  the  potential  input  media  — 
ie,  page-like  material,  microfilm,  and  punched  cards  - would  involve  some  type  of 
electro-optical  scanning  technology  to  put  the  message  into  a format  for  electronic  trans- 
mission. It  is  the  page-like  material  and  the  scanner  technology  required  to  read  it  that 
the  remainder  of  this  report  is  concerned  with. 


EMS  GOALS 

The  phrase  “page-like  material”  can  imply  many  formats  such  as  typed,  drawn,  or 
handwritten  information  of  various  colors  on  paper  of  almost  any  color  and  continuous 
tone  pictures  that  may  be  in  black  and  white  or  many  colors.  The  Office  of  Advanced 
Mail  Systems  Development  (AMSD)  has  determined  in  this  initial  analysis  that  it  will 
ultimately  be  necessary  to  scan  page-like  material  with  these  criteria: 

1.  The  data  can  be  in  typed,  printed,  handwritten,  or  continuous  tone  form. 

2.  The  text  data  can  be  most  colors  on  most  colors  of  paper. 

3.  The  continuous  tone  data  can  be  black  and  white  or  multicolor. 

4.  The  scanning  technique  must  be  capable  of  at  least  80  lines  per  centimetre 
(200  lines  per  inch). 

5.  Within  the  limits  of  system  resolution,  the  quality  of  the  reproduced  trans- 
mitted message  must  be  very  nearly  equal  to  that  of  the  original. 

In  addition  to  the  above  input  criteria,  AMSD  has  determined  that  the  material 
must  be  scanned  at  a rate  equivalent  to  twenty  8Vi-by-l  l-inch  pages  per  second  in  order 
to  handle  the  volume  anticipated  for  an  EMS  system.  As  a point  of  comparison  messages 
currently  sent  by  facsimile  are  handled  at  a rate  of  4800  bits  per  second.  At  this  bit  rate 
it  would  take  fascimile  transmission  equipment  78  minutes  to  transmit  a black  and  white 
image  with  EMS  quality. 


NELC  MISSION 

The  large  disparity  between  existing  scanning  technology  and  the  goals  of  the 
envisioned  EMS  required  the  implementation  of  a major  development  program.  In 
October  1974  the  USPS  and  NELC  signed  an  agreement  in  which  NELC,  primarily  the 
Display  Division,  agreed  to  provide  technical  support  for  1 year  for  the  development  of 
scanning  technology  for  the  very  advanced  EMS  system.  Acceptable  progress  during  1975 
resulted  in  the  issuance  of  a second  agreement  for  work  to  begin  in  October  1975.  A 
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Figure  1.  USPS  Electronic  Message  Service. 


EMS  INPUT  MEDIA  OPTIONS 


m 


1 


report  was  written  to  summarize  the  first  year’s  accomplishments.*  This  report  covers 
the  second  year’s  work  beginning  10  October  1975  and  ending  9 October  1976. 

Tasks  performed  and  services  provided  by  NELC  during  these  2 years  have 
included: 

1 . Survey  of  available  imaging  devices  and  technologies  and  comparative  analysis 
of  capabilities 

2.  Characterization  of  imaging  devices  with  respect  to  dynamic  range,  sensitivity, 
and  spectral  response 

3.  Characterization  of  various  illumination  sources  and  techniques 

4.  Design  and  construction  of  a test  bed  for  use  in  demonstrating  and  evaluating 
hardware,  software,  and  techniques  for  image  scanning  at  the  specified  rates 

5.  Investigation  of  video  compression,  image  enhancement,  and  data  compression 
techniques 

6.  Generation  of  high-quality  test  images  that  are  stored  on  tape;  enhancement  of 
data  and  comparison  of  results  with  original  images 

7.  Development  of  illumination  correction  techniques 

8.  Evaluation  of  lenses  for  use  in  image  scanning 

9.  Compilation  of  technical  reports  on  specific  aspects  of  the  work  as  well  as 
progress  and  year-end  summary  reports 

10.  Consultation  and  support  services  including  the  monitoring  of  hardware 
contracts,  evaluation  of  proposals,  and  writing  of  procurement  specifications 


1975  HIGHLIGHTS 

Some  significant  accomplishments  of  the  year  ending  21  October  1975  included: 

1.  A 12-inch  drum  scanner/frame  store  memory  test  bed  was  designed,  fabricated, 
and  operated. 

2.  Promising  newly  available  large  high-speed  imagers  were  procured  and  success- 
fully evaluated.  (Previously  it  appeared  that  several  smaller  solid-state  imagers  mounted 
on  a very  critical  optical  mixing  device  would  be  required  to  scan  a full  page  width.) 

3.  The  investigations  into  edge  and  image  enhancement  techniques  were  begun. 

In  conjunction  with  these  efforts  it  was  determined  that  a prestorage  image  analyzer 
could  be  used.  The  design  of  an  analyzer  was  completed  and  successfully  operated. 

4.  Methods  of  achieving  nonlinear  video  amplitude  partitioning  and  of  establishing 
dynamic  range  and  automatic  threshold  detection  were  studied,  and  designs  for  later 
installation  in  the  scanner/frame  store  memory  test  bed  were  completed. 

s 1 


•First  Annual  Report  Advanced  Mail  Systems  Scanner  Technology,  22  October  1975,  prepared  by 
NELC  Display  Division,  NELC  TR  1965. 
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1976  TASKS 

For  the  year  ending  9 October  1976,  the  services  performed  can  be  divided  into 
five  categories.  The  categories  and  the  tasks  within  each  are  listed  below. 

Hardware  deliverables 

Design  and  build  large  drum  scanner  assembly. 

Improve  illumination  source. 

Build  driver  boards  for  new  imagers. 

Design  and  build  peripheral  interfaces  for  test  bed. 

Add  multimode  input  to  the  image  analyzer. 

Integrate  all  hardware  units 
Evaluate  various  imagers  and  systems. 

Software  deliverables 

Program  high-speed  ROMs  with  microcodes. 

Design  and  implement  system  utility  programs. 

Design  and  implement  image  handling  programs. 

Design  and  implement  high-level  procedure  program. 

Document  deliverables 

Prestorage  processing  preliminary  report. 

Frame  store  memory  and  display  memory  controller  second  report. 

Advanced  imager  summary  report. 

Data  compression  summary  report. 

Image  enhancement  report. 

Reliability /warranty  report. 

Major  procurement  contracts 

Imager  for  time  delay  integration  (TDI)  with  RCA 
Support  services 

Provide  technical  portion  of  the  4 to  10  pages  per  second  scanner  specifica- 
tion for  AMSD. 

Review  technical  section  of  proposals  that  were  submitted  in  response  to  the 
above  scanner  specification. 

Provide  technical  liaison  support  between  various  vendors  and  AMSD. 
Provide  technical  consultation  to  AMSD  as  requested. 

Some  of  the  categories  of  effort  involved  considerable  overlap  - notably  hardware, 
software,  and  documentation.  In  the  next  section  of  this  executive  summary  the  first  two 
categories  of  tasks  are  described  in  detail.  The  material  presented  for  the  third  category. 
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document  deliverables,  will  be  essentially  the  results  and/or  conclusions  from  each  docu- 
ment, because  each  is  included  in  its  entirety  as  an  appendix.  The  fifth  category,  support 
services,  is  not  detailed  further. 


1977  FLANS 

The  plans  for  FY77  will  follow  much  the  same  format  as  those  for  FY76.  The 
categories  of  work  and  the  tasks  within  each  are  listed  below. 

Hardware  deliverables 

Obtain  and  evaluate  any  new  imagers  that  appear  during  the  year  that  may 
be  suitable  for  Postal  Service  use. 

Implement  the  tracking/TDI  mode  via  test  bed  hardware  and  evaluate 
available  devices,  including  the  RCA  TC-1 155  camera  and  the  new  area 
imager  RCA  is  scheduled  to  deliver  about  midyear. 

Exploit  the  frame  store  memory  and  its  control  to  achieve  elastic  buffering, 
block  void  encoding,  and  two-dimensional  image  enhancement  and 
compression. 

Acquire  test  bed  hardware  to  implement  the  most  promising  image  enhance- 
ment concepts  that  currently  exist  in  software  form. 

Investigate  the  potential  for  reducing  the  expected  frame  store  memory 
capacity  requirements  by  prestorage  processing  and  further  exploitation  of 
the  image  analyzer  hardware. 

Evaluate  techniques  for  outputting  the  image  data,  as  stored  in  the  frame 
store  memory,  for  the  purpose  of  recreating  the  image  on  paper  (or 
equivalent). 

Software  deliverables 

Conduct  further  studies  in  image  enhancement,  taking  into  account  FY76 
results,  and  implement  findings  in  software. 

Design  and  implement  techniques  for  investigating  in  detail  various  data 
compression  techniques  including  Walsh,  Fourier,  slant,  and  differential 
pulse  code  modulation  (DPCM). 

Document  deliverables 

Frame  store  memory  and  display  third  report 
Advanced  imager  summary  report 
Data  compression  summary  report 
Advanced  prestorage  processing  report 
Monthly  progress/technical  reports 
Third  annual  report  of  total  program 
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Major  procurement  contracts 

Continue  development  of  the  tracking  TDI  imager. 

Investigate  possible  procurement  of  laser  scanning  breadboard  hardware  for 
evaluation  in  EMS  systems. 

Support  services 

Provide  technical  liaison  support  between  various  vendors  and  AMSD. 
Provide  technical  consultation  to  AMSD  as  requested. 
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TASK  SUMMARIES 


HARDWARE 


LARGE  DRUM  SCANNER 

The  year  was  started  using  the  small  drum  ( 1 2-inch  circumference)  test  bed  (SDTB); 
however,  this  drum  size  did  not  match  what  Pitney  Bowes  had  selected  in  their  development 
of  paper  handling  equipment,  so  design  and  fabrication  of  a new  compatible  large  drum  test 
bed  (LDTB)  were  initiated.  The  LDTB  included  a 40-inch  circumference  drum  and  a 
Baldwin  incremental  encoder  which  put  out  8192  pulses  per  revolution.  Drum  speeds  from 
1/5  to  352  revoltuions  per  minute  were  provided.  The  power  supplies,  imager  mount,  and 
card  cage  were  transferred  from  the  SDTB.  Fluorescent  lamps  were  installed  as  the  initial 
illumination  light  source.  The  LDTB  was  put  into  service  in  early  June  and  has  been  used 
continuously  with  no  further  mechanical  modifications.  Additional  details  and  drawings  of 
the  two  scanner  test  beds  can  be  found  in  appendix  C.  Figure  3 is  a photograph  of  the  hard- 
ware being  developed  for  the  USPS.  The  LDTB  is  located  in  the  right  center  portion  of  the 
photo. 


ILLUMINATION 

In  order  to  implement  the  envisioned  EMS  system,  two  important  considerations 
exist  in  the  area  of  illumination:  the  rate  of  message  handling  and  the  quality  of  end  pro- 
duct. The  First  item,  message  rate,  implies  that  more  light  is  required  as  the  page  rate  in- 
creases, and  it  appears  that  there  are  ways  of  getting  more  light  on  the  page  if  it  is  needed 
for  any  particular  sensor  configuration.  However,  the  second  item,  a high-quality  end 
product,  is  of  prime  concern  no  matter  what  the  page  rate  may  be.  It  is  the  meeting  of 
this  goal  that  has  dictated  much  of  the  work  to  be  described  below.  Any  variation  in  light 
output  over  the  width  of  a page,  if  not  corrected,  ultimately  looks  like  data  to  the  repro- 
ducing hardware  and  thus  detracts  from  the  quality  of  the  end  product. 

The  SDTB  used  a quartz  halogen  lamp  for  illumination.  For  several  reasons  this 
type  of  lamp  contributed  heavily  to  poor  end  product  quality.  As  an  alternative  source, 
high-brightness  flourescent  lamps  were  evaluated  and  found  to  be  a significant  improve-' 
ment.  These  lamps  thus  became  the  source  used  in  the  LDTB. 

The  lamps,  however,  were  not  the  ultimate  solution,  since  there  is  a consistent 
dropoff  in  light  gathered  by  the  scanner  lens  at  each  end  of  the  scanned  line.  In  order  to 
compensate  for  this  deficiency  a software  technique  was  devised  to  correct  for  this  phe- 
nomenon - in  fact  it  corrects  for  nearly  all  problems  that  result  in  nonuniformity  of  the 
sensor  portion  of  the  scanning  system  across  the  page.  The  imager  scans  a high-quality 
white  test  target,  and  the  resulting  video  signal  is  used  to  generate  a correction  factor,  pel 
by  pel,  for  all  message  data  to  follow  until  another  correction  scan  is  made.  The  correc- 
tion technique  makes  the  system  appear  to  have  a perfectly  flat  response  over  the  width 
of  the  page  to  within  ±1/2  least  significant  bit  from  the  scanner  analog-to-digital  encoder. 
Details  of  the  correction  technique  and  the  illumination  sources  are  included  in  appendix  C. 
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The  illumination  problem  discussed  above  applies  independently  of  the  color  of 
the  image.  There  is  another  problem  that  is  color  dependent  even  though  the  reproduction 
may  be  black  on  white.  The  fluorescent  lamps  used  were  basically  green  illuminators,  and 
thus  if  green  ink  were  used  in  the  message  being  scanned  the  contrast  between  the  white 
paper  and  the  green  ink  would  be  very  low  - in  the  worst  case  the  imager  would  tell  the 
system  a blank  page  was  being  scanned.  The  answer  to  this  problem  is  to  provide  either 
very  broadband  illumination  (white  light)  or  three  different  colors  of  illumination  (red, 
green,  and  blue)  and  then  to  select  the  source  that  produces  the  highest  contrast.  The 
latter  approach  is  the  more  desirable  one,  since  an  eventual  goal  of  reproducing  messages 
in  color  is  foreseen.  In  order  to  pursue  this  approach,  special  fluorescent  lamps  of  the 
high-brightness  type  were  procured  from  Sylvania  containing  red,  green,  and  blue  phos- 
phors that  were  mixed  in  the  ratio  of  1:2:8,  respectively.  This  ratio  compensates  for  the 
falloff  in  sensitivity  of  the  imager  from  red  to  blue.  The  net  effect  is  that  the  imager  pro- 
duces the  same  output  signal  for  each  color  when  a white  test  target  is  placed  on  the  scan- 
ner drum  and  a red,  green,  or  blue  filter  is  placed  in  front  of  the  imaging  lens.  Details  on 
this  work  are  covered  in  appendix  E under  the  subject  of  Color  Filtering.  This  area  will 
get  much  more  attention  in  FY77. 

IMAGING  DEVICES  AND  SYSTEMS 

Two  sizes  of  CCD  imagers  were  used  in  the  scanner  test  bed  during  FY76: 

Fairchild  CCD-1 10,  a 256x1  pel  device 

Fairchild  CCD-1 21,  a 1728x1  pel  device 

Problems  were  encountered  with  them  that  have  apparently  been  eliminated  in 
newer  versions  of  these  devices  and  in  a completely  new  device  that  Fairchild  has  put  on 
the  market,  the  CCD-1 31  DC.  This  device  has  1024  pels  and  two  output  ports  that  are 
capable  of  being  clocked  at  a rate  of  12  megapels  per  second  each  for  an  effective  rate  of 
24  megapels  per  second.  Improvements  that  were  made  in  the  Fairchild  imager  include: 

Better  arrangements  in  assigning  signals  to  pins,  thus  lowering  crosstalk  levels 

Hermetic  sealing 

Opaque  shields  over  the  transfer  gates  to  eliminate  peripheral  vision 

Increasing  the  saturated  output  signal  voltage  to  0.75  volt  from  0.200  volt  for  the 

CCD-121  and  CCD-131 

Table  2 in  appendix  C summarizes  the  features  of  the  known  imagers  as  ot  early 
June  1976  and  ranks  the  devices  as  to  applicability  to  DSPS  ptoblems.  The  emergence  of 
new  and  improved  devices  has  changed  the  ranking.  Table  1 of  this  executive  summary 
lists  the  prime  characteristics  of  'he  Tint  five  devices  as  of  the  end  of  FY76. 

Other  image?  work  accomplished  during  the  year  involved  the  evaluation  of  the  RCA 
TC-1  <55  itteYisi'on  camera  that  incorporated  the  SID-51232  surface  channel  CC  D imager. 
COfnplete  details  of  this  work  are  contained  in  appendix  C.  This  imager  is  of  interest  be- 
cause of  its  possible  application  to  the  TDI  mode  of  imager  operation  which  is  ranked  num- 
ber 1 in  table  1 . The  SID-5 1232  tested  by  NELC  had  three  major  deficiencies,  two  of 
which  were  development-oriented  and  thus  probably  could  be  improved  to  an  acceptable 
level.  The  third,  the  need  for  background  bias  illumination,  was  inherent  with  the  type 
construction  and  was  judged  to  be  highly  undesirable. 


22 


TABLE  1.  RELATIVE  APPLICABILITY  OF  VIDEO  SENSORS  FOR  ELECTRONIC  MESSAGE  SERVICE. 


The  camera  was  subsequently  returned  to  RCA  for  replacement  of  the  imager  with 
an  improved  type  and  modification  of  the  camera  for  use  in  the  TD1  mode  with  the  scanner 
test  bed.  Since  the  TD1  work  had  not  begun  by  the  end  of  FY76,  no  real  evaluation  of  the 
new  imager  could  be  made.  It  was  operated,  however,  in  a superficial  way  with  a strobe 
light  that  did  verify  its  functional  capability.  The  TD1  mode  of  operation  will  be  an  area 
of  prime  importance  in  FY77  work. 


IMAGER  DRIVER  BOARDS 

The  SDTB  was  operated  until  it  was  retired  with  the  Fairchild  CCD-1 10  imagers. 

This  scanner  assembly  served  more  as  a signal  source  to  check  out  the  complete  test  bed 
than  to  evaluate  scanners  or  take  data.  By  the  time  the  LDTB  was  operational,  confidence 
in  the  overall  system  had  risen  to  the  point  at  which  operational  characteristics  of  the  scanner 
could  be  identified  and  separated  from  the  test  bed  overall  performance.  It  was  determined 
while  using  the  SDTB  that  the  circuit  boards  furnished  by  Fairchild  for  demonstrating 
their  CCDs  were  not  adequate  for  the  clocking  speeds  required  in  the  scanner  test  bed.  New 
CCD  driver  boards  were  designed  and  fabricated  using  the  best  in  high-speed  logic  techniques 
and  keeping  the  analog  signals  separated  from  the  digital  signals.  When  the  Fairchild 
CCD-1 21  (1728  pels)  was  installed  and  fired  up,  two  peculiarities  were  noted.  They  involved 
changes  Fairchild  had  incorporated  into  the  larger  devices.  One  was  solved  by  adding  reverse 
pulse  clamping  diodes  to  the  clocking  pulses  on  the  circuit  board  and  the  other  required 
reverting  back  to  capacitor  coupling  for  the  board  output  amplifier.  The  improved  CCD-121 
driver  board  was  subsequently  used  for  about  the  last  half  of  FY76. 


IMAGE  ANALYZER  MULTIMODE  INPUTS 

The  functional  ability  of  the  image  analyzer  portion  of  the  scanner  test  bed  was 
expanded  early  in  the  year  to  provide  the  ability  to  do  “first  derivative”  statistics  (FD  stats) 
and  “run  length”  statistics  (RL  stats)  in  addition  to  the  original  “pel  brightness”  statistics 
(PB  stats).  The  hardware  concept  changes  are  detailed  in  appendix  A while  the  utilization 
of  the  hardware  is  discussed  in  appendix  C.  The  analyzer  performs  only  one  of  the  three 
functions  at  a time  on  instruction  by  the  frame  store  memory  controller.  The  operation 
of  each  function  is  performed  by  hardware  processing.  As  utilized  in  the  USPS/NELC  test 
bed,  the  analyzer  gets  its  input  from  raw  image  data  stored  on  magnetic  tape,  and  the  tape 
must  be  run  through  once  for  each  type  of  statistical  data  desired. 

The  image  analyzer  was  developed  to  accomplish  two  tasks:  to  aid  the  scanner 
test  bed  in  producing  the  very  best  stored  image  data,  and  to  produce  quantitative  data 
about  various  images  for  data  compression  technique  development.  The  first  task  makes 
use  of  the  PB  stats  to  expand  the  dynamic  range  of  the  imager  video  signal  so  as  to  just 
fill  the  dynamic  range  of  the  analog-to-digital  converter.  The  second  task  requires  the  use 
of  all  three  types  of  statistical  data  in  order  to  design  the  method  of  data  compression  to 
be  implemented  in  the  hardware. 

Several  important  facts  have  been  obtained  from  the  image  analysis/data  studies 
accomplished  in  FY76.  These  include 

1.  Pel  brightness  statistics  for  typewritten  pages  and  continuous  tone  photographs 
appear  to  have  characteristics  sufficiently  different  that  an  algorithm  could  be  generated  to 
identify  which  type  of  message  is  being  processed. 
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2.  First  derivative  statistics  failed  to  show  expected  large  differences  in  adjacent  pel 
brightness  levels,  which  suggests  that  the  imaging  lens  does  not  have  the  resolving  power  re- 
quired for  80  pels/cm. 

3.  Run  length  statistics  showed  a very  large  number  of  very  short  runs  in  the  least 
significant  bit  planes,  which  pointed  up  the  unbalanced  output  from  the  two  analog  trans- 
port registers  of  the  CCD  imager  and  tended  to  produce  relatively  low  compression  ratios. 
The  new  CCD-1 2 1H  imager  should  clear  up  this  problem. 

4.  Variable  length  coding  algorithms  exhibited  higher  compression  ratios  than 
fixed  length  codes. 

5.  The  use  of  Gray  coding  produced  about  30%  more  compression  with  any  algo- 
rithms than  did  binary  coding. 

All  the  above  conclusions  are  discussed  in  appendix  D in  detail;  however,  it  will  be  FY77 
before  suggested  hardware  changes  can  be  made  or  questions  that  emerged  can  be  investi- 
gated to  the  point  of  conclusion. 


PERIPHERAL  INTERFACES 

During  FY76  several  interface  channels  were  added  to  the  frame  store  memory 
controller: 

Input  and  output  to  a Kennedy  model  9000  tape  deck  via  a model  92 1 7 Format 

Control  Unit 

Input  and  output  to  a Bright  model  BI-2600  tape  deck 

Output  to  a Tektronix  model  4632  hard-copy  printer 

Other  channels  were  expanded  in  capability: 

Input  and  output  to  the  Tektronix  model  4023  computer  terminal 

Input  and  output  for  the  imager  analyzer  FD  stats  and  the  RL  stats 

The  output  channel  for  a Conrac  RQB-1 7 monitor  was  made  in  FY75  and  continues 
to  be  used  as  originally  implemented. 

The  Kennedy  tape  deck  is  used  as  the  prime  storage  element  for  storing  a complete 
image  from  the  LDTB.  It  works  through  the  Format  Control  Unit,  which  can  handle  up  to 
four  tape  decks.  Eventually  it  will  be  required  to  drive  a second  tape  deck,  because  the 
Bright  unit  is  on  temporary  loan  from  other  NELC  programs.  The  Bright  unit  is  used  for 
temporary  storage  in  the  development  of  image  enhancement  techniques  and  for  illumina- 
tion correction.  The  Tektronix  terminal  and  printer  units  are  also  GFE  from  other  programs. 
It  has  been  necessary  to  share  these  units  during  the  year  with  the  owners,  which  has  caused 
some  minor  program  workarounds. 


SOFTWARE 

The  USPS/NELC  Test  Bed  is  capable  of  being  commanded  via  the  Tektronix  4023 
terminal  and  the  Monitor  Command  Summary  instruction  set  (table  2).  This  set  of  instruc- 
tions is  the  means  by  which  operational  programs  are  entered  and  generated.  The  actual 


TABLE  2.  MONITOR  COMMAND  SUMMARY. 


TRANSFER  (address) 

TABULATE  (address) 
INSPECT  AND  CHANGE 
GO  TO  (address) 

TEXT 

READ  (tape)  (address) 
DATA  (address) 

WRITE  (tape)  (add)  (add) 
EMC 

REWIND  (tape) 

FILEMARK  (tape) 
LIBRARY  (tape) 

SHOW  (page) 

UPDATE  PAGE  (page) 
UPDATE  LIBRARY 
HISTOGRAM  (dis)  (add) 

POSITION  (tape)  (file)  (rec) 
MOVE  (add)  (add) 

RESET  (lib) 

RESET  (histogram) 

RESET  (stats) 

JSR  (address) 

SEARCH  (add)  (add)  ( word) 
(mask) 

SBK 

BBK 

SFK 

BFK 

STATUS 


SET  (status) 
CONTINUE 


Transfer  64  words  from  analyzer  to  location  in  memory  beginning 
at  (address) 

Tabulate  on  terminal  display  64  words  beginning  at  (address) 

Allows  inspection  and  change  of  memory  cell  from  keyboard 
Transfer  program  control  to  (address) 

Allows  entry  of  textual  data  for  printing  on  terminal 
Loads  data  from  (tape)  to  (address) 

Allows  entry  of  a sequence  of  signed  decimal  integers  at  (address) 

Write  data  on  (tape)  between  (address)  and  (address) 

Enters  new  monitor  command 
Rewind  specified  (tape)  to  load  point 
Writes  filemark  on  specified  (tape) 

Loads  library  from  specified  (tape)  into  memory  and  displays  page  one 
Displays  specified  (page)  on  terminal 

Places  terminal  display  in  memory  at  specified  (page)  location 
Places  memory  copy  of  library  on  tape  in  library  file 
Places  64  histogram  values  on  specified  (display)  starting  from  specified 
memory  (address) 

Position  specified  (tape)  to  (file)  number  and  (record)  number 
Move  data  from  (address)  to  (address) 

Clears  all  pages  of  specified  (library) 

Clears  refresh  for  display 

Sets  (statistical)  block  in  memory  to  zero 

Selects  subroutine  at  specified  (address) 

Modifies  all  occurrences  of  a specified  bit  pattern  between  (address) 
and  (address) 

Position  Kennedy  tape  at  block  1 

Position  Kennedy  tape  at  block  1 unless  already  at  beginning  of  file 

Position  Kennedy  tape  at  beginning  of  next  file 

Position  Kennedy  tape  at  beginning  of  current  file 

Displays  current  position  of  tape  units,  contents  of  various  portions 

of  memory,  and  image  display  conditions 

Set  or  reset  specified  (status)  line 

Returns  program  control  to  any  program  using  the  system  monitor 
as  a subroutine 
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operational  programs  are  built  up  from  a set  of  user  accessible  instructions  referred  to  as  the 
Macro  Instruction  Set  (table  3).  Some  of  these  instructions  perform  relatively  simple  tasks, 
but  some  are  very  involved  and  powerful.  For  example,  instruction  210  captures  a com- 
plete image  from  the  LDTB  and  instruction  215  repetitively  displays  an  image  on  the  high- 
resolution  monitor.  More  detailed  descriptions  of  the  macro  instructions  can  be  found  in 
appendix  B.  The  complete  hierarchy  of  operational  program  levels  includes: 

Microcodes 

Macro  instructions 

Subroutines 

Utility  programs 

Image  handling  programs 

High-level  procedure  program 

All  these  levels  are  discussed  further  in  the  following  sections. 

MICROCODES  IN  HIGH-SPEED  ROMs 

Each  of  the  macro  instructions  discussed  above  essentially  calls  out  the  starting 
address  of  a set  of  microcodes  stored  in  PROMs  (programmable  read  only  memories).  The 
microcodes  contain  the  actual  hardware  instruction  details  necessary  to  implement  the 
macro  instruction.  FY76  was  started  with  Intel  1702A  UV  erasable  low-speed  PROMs  in 
the  memory  controller;  by  midyear  these  had  been  replaced  with  12  Monolithic  Memory 

6306-IJ  high-speed  PROMs  that  were  programmed  by  the  vendor  with  the  microcode  data 
furnished  by  NELC. 


SYSTEM  UTILITY  PROGRAMS 

In  developing  the  program  to  process  the  image  data  in  the  complete  test  bed,  it  was 
found  that  there  were  many  small  groups  of  macro  instructions  that  were  repeatedly  used. 
These  were  subsequently  organized  into  a set  of  “subroutines”  that  could  be  called  upon 
much  as  a microcode.  (The  final  subroutines  will  be  documented  in  the  FY77  Frame  Store 
Memory  and  Display  Report.)  Then  with  the  repertoire  of  macro  instructions  and  sub- 
routines many  larger  utility  programs  were  developed  for  manipulating  data  in  memory  and 
on  tape  including: 

Write  on  tape 
Read  from  tape 

Locate  specific  blocks  of  data  on  tape 
Move  data  around  on  tape 
Inspect  and  change  memory  word 
Search  through  memory 
Program  library  manipulations 

Transfer  statistics  generated  by  image  analyzer  into  memory 
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TABLE  3.  MACRO  INSTRUCTION  SET. 


Opcode 

Mnemonic 

Function 

Opcode 

Mnemonic 

200 

LDA 

Load  A 

240 

SRO 

201 

LADAX(X) 

Load  A indexed 

241 

SRZ 

202 

STA 

Store  A 

242 

SLZ 

203 

STAX(X) 

Store  A indexed 

243 

SRC 

204 

LDX(X) 

Load  index 

244 

AND 

205 

STX(X) 

Store  index 

245 

IOR 

206 

LSP 

Load  stack  pointer 

246 

XOR 

207 

LDK(X) 

Load  K-register 

247 

COM 

210 

CAPT 

Capture 

250 

4DD 

211 

CLX(X) 

□ear  index 

251 

SUB 

212 

INX(X) 

Increment  index 

252 

INC 

213 

DCX(X) 

Decrement  index 

253 

DEC 

214 

DSZ(X) 

DCX,  skip  0 result 

254 

CLA 

215 

DISP 

Display 

255 

216 

HALT 

Halt 

256 

SMC 

217 

NOP 

Null  operation 

257 

220 

JP 

Jump  unconditional 

260 

MPR(Y) 

221 

invalid 

261 

TRAX(X) 

222 

invalid 

262 

TRXA(X) 

223 

JNN 

Jump  A>  0 

263 

PUSH 

224 

JPN 

Jump  A < 0 

264 

POP 

225 

JPZ 

Jump  A = 0 

265 

LDAC 

226 

JNZ 

Jump  A 0 

266 

ADDC 

227 

invalid 

267 

SUBC 

230 

invalid 

270 

CAPL 

231 

JPX(X) 

Jump  indexed 

271 

OUTV(X) 

232 

JPA 

Jump  A 

272 

233 

BYT 

Shift  right  8 bits 

273 

INPT(X) 

234 

JPI 

Jump  indirect 

274 

OUTT(X) 

235 

JPR 

Jump  subroutine 

275 

INP(X) 

return 

236 

JSR 

Jump  to  subroutine 

276 

OUT(X) 

*237 

SKIP 

Skip  on  skip  x set 

277 

SIOC(X) 

(x)  indicates  modifier  sensitive 
* not  yet  implemented 
TOS  = top  of  stack 


Function 

Shift  A right,  1 fill 
Shift  A right,  0 fill 
Shift  A left,  0 fill 
Shift  A right,  circular 
Logical  AND 
Logical  OR 
Logical  XOR 
Complement 

Add  A 
Subtract  A 
Increment  A 
Decrement  A 
Clear  A 

Set  MOS  clock 

Memory  protect 
Transfer  (A)  to  index 
Transfer  (index)  to  A 
(A)  placed  on  TOS 
(TOS)  placed  in  A 
Load  A with  constant 
Add  constant  to  A 
Subtract  constant  from  A 

Capture  line 
Output  video  tape  ch  x 

Input  from  tape  ch  x 
Output  to  tape  ch  x 
Input  on  ch  x 

Output  on  ch  x 
Skip  on  I/O  cond  x 
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Display  tabular  or  histogram  data  on  terminal 

System  status  monitoring 

IMAGE  HANDLING  PROGRAMS 

Using  the  macro  instruction  set,  subroutines,  and  the  system  utility  programs, 
higher-level  programs  were  developed  in  FY76  for  manipulating,  correcting,  and  analyzing 
the  image  data  received  from  the  LDTB.  It  is  through  the  use  of  these  image  handling 
programs  that  the  bulk  of  the  information  collected  for  the  USPS  is  obtained.  Programs 
in  the  image  handling  library  include: 

High-resolution  monitor  display  routines 

Image  analyses 

Image  enhancement  routines  for: 

recursive  digital  filtering 
nonrecursive  enhancement 

Logarithmic  video  compression 

Illumination  correction 

Generation  of  illumination  correction  curve 

Compression  ratio  calculations 

Reformatting  of  data  to  send  out  for  hard-copy  processing 

Generation  of  test  images  for  checking  various  algorithms 

The  theory,  algorithms,  and  results  of  the  image  enhancement  programs  and  logar- 
ithmic video  compression,  along  with  color  filtering  and  separation,  are  discussed  in  detail 
in  the  Image  Enhancement  Report,  which  is  appendix  E to  this  summary  report.  Major 
developments  reported  in  appendix  E include: 

1 . The  nonrecursive  enhancement  technique  provides  symmetry  that  the  recursive 
filter  technique  does  not. 

2.  The  nonrecursive  algorithm  appears  to  give  the  better  enhancement  results. 

3.  The  proper  choice  of  color  filtering  for  images  other  than  black  and  white  can 
greatly  enhance  the  paper-to-ink  contrast. 

4.  A logarithmic  compression  formula  was  derived  from  which  commercial 
logarithmic  analog-to-digital  converters  could  be  programmed. 

5.  There  is  little  observed  difference  between  a 6-bit  linear  and  a 5-bit  companded 

image. 

6.  Four-bit  companded  images  show  noticeable  contouring. 

HIGH-LEVEL  PROCEDURE  PROGRAM 

In  order  to  do  a complete  image  analysis  with  a minimum  of  operator  attention, 
various  image  handling  programs  were  organized  into  a “high-level  procedure  program.” 
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This  program  was  used  extensively  in  collecting  data  for  appendix  D,  the  Data  Compression 
Report,  and  will  be  used  extensively  in  the  future.  Because  much  of  the  processing  involves 
moving  data  into  and  out  of  magnetic  tape  storage,  a complete  run  of  this  program  for  one 
image  requires  about  2-1/2  hours.  Major  functions  of  this  program  include: 

Set  up  the  Kennedy  tape  for  accepting  data  from  memory. 

Capture  white  standard  from  LDTB  and  store  on  tape. 

Capture  image  from  LDTB  and  store  on  tape. 

Using  white  standard  data,  correct  image  data  for  illumination  nonuniformity. 
Transfer  image  data  between  tape  units  as  required  for  image  processing. 

Instruct  image  analyzer  for  all  statistical  data  gathering  functions. 

Store,  display,  and/or  print  statistical  data  generated  by  imager  analyzer. 

DOCUMENTATION 

During  the  year  monthly  progress/technical  reports  and  six  specific  subject  technical 
reports  were  written  and  submitted  to  AMSD.  The  reports  and  dates  of  publication  are: 


A. 

Prestorage  Processing  Preliminary  Report 

26  May  1976 

B. 

Frame  Store  Memory  and  Display  Second  Report 

22  May  1976 

C. 

Advanced  Imager  Summary  Report 

28  June  1976 

D. 

Data  Compression  Summary  Report 

October  1976 

E. 

Image  Enhancement  Report 

October  1976 

F. 

Reliability  Prediction  Report  on  the  Scanning 
Imager  Electronics 

September  1976 

These  reports  are  included  in  their  entirety  as  appendixes  A through  F to  this  annual 
report.  The  subject  matter,  results,  and  conclusions  of  the  first  five  appendixes  have  been 
discussed  in  earlier  sections  of  this  executive  summary.  The  Reliability  Prediction  Report, 
appendix  F,  discussed  the  reliability  aspects  of  a hypothetical  scanning  imager  electronics 
system  such  as  might  be  used  in  an  EMS  system.  The  hypothetical  system  was  patterned 
after  the  equipment  developed  here  at  NELC  but  expanded  to  handle  an  entire  page.  Con- 
clusions reached  in  this  report  included: 

1.  The  MTBF  (mean  time  between  failures)  of  the  hypothetical  system  was  82  hours 
with  the  4000-bit  MOS  memory  chips  NELC  is  presently  using. 

2.  The  principal  contributor  to  the  low  MTBF  is  the  large  number  of  memory 
chips  - 6000  in  the  hypothetical  system. 

3.  The  MTBF  could  be  raised  to  246  hours  by  using  64000-bit  MOS  memory  chips, 
thus  reducing  the  6000  chips  in  the  memory  to  375. 

4.  The  MTBF  could  be  increased  to  over  1 200  hours  by  switching  to  an  integrated 
injection  logic  (I^L)  memory  device. 

5.  The  reliability  of  the  imaging  device  does  not  measurably  alter  the  MTBF  of  the 
model  equipment. 
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The  above  conclusions  are  theoretical  calculations;  however,  they  are  based  on 
models  presented  in  MIl^Handbook-2 1 7,  the  standard  accepted  by  DoD  as  the  guide  for 
all  military  electronics  equipment  reliability  predictions.  Note  that  the  very  nature  of  this 
handbook  requires  that  it  be  conservative.  About  nine  failures  in  1475  hours  of  operation 
were  predicted  by  the  use  of  its  models  for  the  equipment  here  at  NELC.  Only  one  was 
actually  experienced  within  that  period  of  operation. 

[ 

CONTRACTS 

The  only  contract  issued  by  NELC  during  FY76  for  USPS  work  was  with  RCA 
Princeton  for  development  of  a tracking/TDI  imager.  The  imager  will  be  96  pels  high  by 
748  pels  wide  and  will  have  four  output  ports  capable  of  being  clocked  at  21  megapels  per 
second  each.  As  of  this  report  the  fabrication  technology  and  porting  techniques  to  be  used 
have  been  determined.  RCA  is  currently  in  the  process  of  making  the  numerous  photo 
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INTRODUCTION 


Prestorage  processing  is  an  important  adjunct  to  image  acquisition  for  a number  of 
reasons.  By  definition,  prestorage  processing  includes  any  intentional  augmentation  of 
image  data  prior  to  acceptance  of  the  data  into  the  frame  storage  buffer  memory.  This 
processing  includes  prescanner  strategies  to  determine  optimum  color  of  illumination  for 
the  main  scanner,  accumulation  of  statistical  data  pertaining  to  the  distribution  of  re- 
flection densities  of  the  copy,  image  enhancement  algorithms  which  can  be  executed  in 
real  time  “on  the  fly”  without  requiring  buffer  storage,  and  any  of  a number  of  com- 
pression techniques  which  can  reduce  the  final  required  capacity  of  the  frame  storage 
memory. 

This  report  is  devoted  to  a description  of  the  design  and  application  of  an  image 
analyzer.  The  subjects  of  image  enhancement  and  data  compression,  which  may  also 
be  accomplished  by  prestorage  processing,  are  covered  separately  in  subsequent  detailed 
technical  summary  reports. 

It  should  be  emphasized  that  the  image  analyzer  described  herein  is  a highly 
complex  and  versatile  subsystem  of  the  USPS/NELC  image  acquisition  test  bed.  Its 
purpose  is  to  identify  and  exploit  those  parameters  of  various  image  types  which  may 
be  used  to  optimize  the  acquisition,  storage,  and  compressibility  of  the  image  data. 

If  and  when  successful  algorithms  are  developed  which  meet  these  goals,  it  is 
planned  that  specifications  for  simple  hardware/software  equipment  can  be  generated. 

Until  such  time  the  image  analyzer  offers  a unique  high-speed  image  analysis  capability 
not  found  in  literature  describing  the  capabilities  of  any  other  image  processing  facility. 


RELEVANCE  TO  MILITARY  APPLICATIONS 

The  word  image  is  used  in  the  name  “image  analyzer”  because  that  is  the  dedicated 
function  for  which  the  equipment  was  designed.  It  can  also  be  used  for  the  tabulation  of 
the  frequency  of  occurrence  of  up  to  2-^  events  in  any  equipment  or  system  at  frequencies 
up  to  about  21  megahertz.  Time  interval  statistics  can  be  acquired  by  using  the  run 
length  counter  mode.  The  first  derivative  mode  can  be  a valuable  asset  in  analizing  data 
for  the  design  of  nonlinear  delta  modulation  systems. 


IMAGE  ACQUISITION  SYSTEM 

A diagram  of  an  advanced  electronic  message  inpfut  terminal  is  shown  in  figure  • 

Al.  Only  those  portions  pertaining  to  prestorage  processing  will  be  described  here.  As 
shown  in  the  diagram,  8 1/2-by-l  1-inch  copy  is  input  to  the  system  at  a rate'of  240 
inches  per  second  or  a page  rate  of  20  pages  per  second.  At  the  prescan  station  there 
are  three  image  sensors  - one  with  red  illumination,  another  with  green,  and  a third  with 
blue.  The  three  colors  of  illumination  will  be  used  for  possible  contrast  improvement  and 
for  future  color  applications. 

Each  of  the  three  outputs  from  these  sensors  is  fed  into  a preamplifier  with 
fixed  gain  and  offset.  The  gain  and  offset  on  all  three  preamplifiers  are  adjusted  so 
that  when  black  velvet,  with  the  lowest  possible  reflectance,  is  placed  in  front 
of  the  image  sensors,  the  resulting  output  from  the  preamplifiers  will  produce  an 
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Figure  A I . Advanced  electronic  message  input  terminal. 


■ 

P 

output  of  all  zeros  from  the  A/D  converters;  and  when  a white  surface  of  BaSC>4 
with  the  highest  possible  reflectance,  is  placed  in  front  of  the  sensors,  the  re- 
sulting outputs  from  the  A/D  converters  will  be  all  ones.  The  weighted,  or  nonlinear, 

A/D  converters  will  convert  data  according  to  Weber’s*  rule  to  minimize  the  total  num- 
ber of  bits  needed  to  represent  each  picture  element,  or  pel. 

The  image  analyzer  is  a statistics  gathering  machine  used  to  supply  image  data 
to  the  mail  mode  selector  where  various  decisions  are  made  to  properly  set  up  system 
controls  for  the  main  scanner  stations.  At  the  present  time  a requirement  is  seen  to 
generate  statistics  which  include  pel  brightness  statistics  (PBS),  run  length  statistics 
(RLS),  and  first  derivative  statistics  (FDS).  Preliminary  tests  may  generate  requirements 
for  additional  statistics  which  may  include  time-dependent  statistics  and  various  two- 
dimensional  codes. 

The  mail  mode  selector  is  a decision  unit  for  the  main  scanner  system  control. 

It  accepts  inputs  from  the  image  analyzer  and  uses  them  for  the  following,  gain  and 
offset  adjustments  of  the  main  scanner  preamplifiers:  selection  of  enhancement  modes, 
which  may  be  either  digital  or  analog;  selection  of  type  of  data  compression;  selection 
of  bit  precision;  and  selection  of  image  resolution.  These  decisions  will  be  discussed  in 
more  detail  in  the  following  section. 

The  image  analyzer  in  the  advanced  electronic  message  input  terminal  as  proposed 
must  analyze  data  from  the  three  image  sensors  at  the  prescan  station  simultaneously. 

It  must  accumulate  all  types  of  statistics  simultaneously.  The  NELC  image  analyzer 
to  be  discussed  is  designed  for  one  input  channel  and  to  accumulate  the  different  types 
of  statistics,  one  at  a time.  It  is  designed  to  accept  data  at  a channel  rate  of  21  mega- 
pels per  second.  Four  or  more  channels  will  be  required  to  produce  the  total  84 
megapel  per  second  design  goal. 

PRESCANNER  IMAGE  ANALYSIS 

EXPECTED  BLACK  ON  WHITE  HISTOGRAM 

Models  are  used  in  the  following  discussion  for  handwritten  or  typed  pages  which 
are  composed  of  ideal  black  ink  on  a white  background.  This  model  assumes  only  very 
small  variations  in  the  uniformity  of  the  background  and  the  ink  within  a line  or  char- 
acter. This  ideal  image  model  will  be  defined  as  one  which  contains  no  white  noise 
due  to  the  scanner  or  any  imperfections  in  the  character  edge  other  than  minor  vari- 
ations of  black  intensity  due  to  print  ink. 

Figure  A2  indicates  the  construction  of  an  ideal  histogram  defining  the  areas  of 
the  typewritten  model  which  are  responsible  for  the  various  regions  of  the  histogram. 

Curve  A in  figure  A2  can  be  explained  in  terms  of  a random  relationship  existing  be- 
tween a pel  and  the  edge  of  the  character.  It  is  reasonable  to  assume  that  there  is  an 
equal  likelihood  of  a pel  being  overlapped  with  respect  to  the  printed  character  edge 
which  will  create  all  levels  of  gray  that  would  exist  between  the  blackest  average  level 
of  the  print  and  the  whitest  average  level  encountered  in  a page.  The  expected  curve  A 
will  be  somewhat  independent  of  pel  size  but  will  be  related  to  the  number  of  edges  found 
in  a particular  image. 

*Not  Weber’s  fraction,  but  a geometrically  proportional  step  increase  for  successive  Gray  levels. 
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Curve  B is  the  result  of  the  percentage  of  the  page  covered  by  typewritten 
information.  The  horizontal  width  of  the  distribution  B will  be  proportional  to  the 
variations  in  the  black  level  found  in  any  character  and  somewhat  associated  with  those 
pel  levels  which  are  related  to  the  registration  ratio  of  black  and  white  at  a character 
edge.  The  amplitude  of  the  B curve  will  be  dependent  upon  the  resolution  at  which 
the  image  is  taken.  In  the  ideal  case  in  which  extremely  high  resolution  is  utilized,  the 
amplitude  of  the  B curve  would  be  its  greatest  and  the  width  would  be  its  smallest.  As 
pel  resolution  is  decreased,  the  peak  amplitude  achieved  is  expected  to  degrade  and  the 
width  of  the  B curve  to  increase. 

The  C curve  shown  in  figure  A2  is  related  to  the  background  of  the  typewritten 
information.  Since  this  is  related  to  the  texture  of  the  paper  and  illumination  uniformity, 
the  width  of  the  curve  will  be  proportional  to  the  variation  of  reflectivity  associated 
with  both  small  and  large  displacements  on  the  paper.  The  small  displacement  vari- 
ations are  basically  due  to  the  grain  and  texture  of  the  paper,  watermarks,  and  other 
identifying  properties  incorporated  in  the  paper  structure.  The  peak  value  of  C will 
be  directly  related  to  the  width  of  the  curve.  Since  the  total  number  of  white  pels  due 
to  the  background  will  be  a known  number,  the  resulting  total  area  under  the  C curve 
will  remain  equal  to  this  number.  Since  the  percent  of  a typewritten  page  which  is 
black  is  generally  small,  the  ratio  of  the  areas  of  the  B and  C curves  will  be  directly 
related  to  the  print  density  on  the  page.  As  a first-order  approximation,  the  ratio  of 
the  area  of  curve  B to  C will  be  in  the  ratio  of  the  area  of  the  page  covered  by  char- 
acters to  the  whole  page.  With  these  ideal  estimates  of  the  properties  that  are  expected 
to  be  found  in  a typewritten  image,  it  is  possible  to  search  the  data  for  these  properties 
and  determine  the  validity  of  this  model. 


EXPECTED  CONTINUOUS  TONE  HISTOGRAM 

Figure  A3  shows  an  ideal  continuous  tone  pel  brightness  histogram  taken  for 
the  pel  levels  expected  to  be  encountered  for  a nominal  ideal  image  model.  The  pre- 
dominant factor  which  distinguishes  the  continuous  tone  image  from  the  typewritten 
image  is  the  difference  in  white  level  that  would  be  expected  on  the  continuous  tone 
image.  Since  a typewritten  page  is  composed  principally  of  a background  which  is  one 
shade  of  white,  a photograph  is  expected  to  contain  more  intermediate  dark  areas.  Fig- 
ure A3  depicts  a higher  number  of  black  tones  in  the  image  than  white.  If  the  image 
contains  sharp  edges  or  boundaries,  again  as  in  figure  A2,  an  A curve  will  be  generated 
which  will  be  related  to  the  number  of  boundary  edges  that  are  found  on  the  image.  The 
remaining  events  when  added  to  the  A curve  generate  the  D curve,  which  represents  the 
total  normalized  number  of  occurrences  at  each  pel  level  for  the  envisioned  model. 


EXPLOITATION  OF  HISTOGRAM  DIFFERENCES 

To  create  all  the  control  lines  necessary  to  operate  the  image  processing  system, 
the  mail  mode  selector  shown  in  figure  A 1 is  flow  diagrammed  in  figure  A4.  Starting 
with  inputs  from  the  red,  green,  and  blue  image  analyzers,  the  mail  mode  selector  is  the 
source  of  the  required  output  control  signals  which  configure  the  main  scanner  electronics. 
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PEL  AMPLITUDE  ■ 
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Figure  A2.  Ideal  typewritten  image  pel 
brightness  histogram. 


Figure  A3.  Ideal  continuous  tone  pel 
brightness  histogram. 
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The  flow  diagram  of  figure  A4  indicates  the  source  inputs  of  the  red,  blue,  and  green 
analyzers  which  are  hardware  mechanizations  that  create  pel  brightness  statistics,  run 
length  statistics,  and  first  derivative  statistics  on  the  prescanned  image.  These  are  shown 
as  being  performed  in  three  colors  for  each  operation.  The  conclusions  obtained  from 
this  investigation  will  provide  a decision  as  to  whether  or  not  data  in  this  volume  are 
needed.  The  results  from  the  R,  G,  and  B statistics  will  be  used  by  the  following  hard- 
ware algorithms,  which  in  turn  will  generate  the  required  control  functions.  These  control 
functions  will  organize  the  main  scanner  electronics  to  accommodate  the  image  in  the 
best  possible  manner.  The  following  will  treat  the  individual  approaches  that  will  be 
taken  in  the  creation  of  the  various  algorithms  for  the  specific  controls  required. 

GAIN 

To  control  the  gain  for  the  analog  amplifiers  that  follow  the  main  scanner 
electronics,  a contrast  algorithm  is  to  be  used.  Referring  to  figure  A2  of  the  ideal 
typewritten  image,  the  contrast  difference  is  defined  as  the  signal  level  between  the 
average  black  print  level  and  the  average  white  background  level  of  the  image.  The 
statistics  derived  from  the  prescanner  will  allow  the  determination  of  the  range  of  the 
average  black  to  average  white  level,  and  from  this  the  gain  will  be  set  for  the  analog 
amplifiers  in  the  main  scanners.  The  gain  adjustment  will  have  a resolution  equal  to  the 
prescanner  A/D  converter  resolution. 


LEVEL 

The  level  algorithms  will  be  developed  in  the  same  manner  as  the  contrast 
algorithms.  Examining  figure  A2  shows  the  average  black  print  level  is  offset  from  zero 
by  a magnitude  which  is  equal  to  the  level.  This  level  adjustment  will  allow  the  range 
of  the  A/D  converter  to  be  offset  so  that  the  full  dynamic  range  of  the  converter  can 
be  matched  to  the  image.  The  main  scanner  analog  amplifier  electronics  will  be  set  by 
the  output  from  this  algorithm  in  increments  of  n,  where  n is  a binary  resolution  deter- 
mined by  the  prescanner  A/D  converter. 


PEL  SIZE 

The  pel  size  for  the  main  scanner  has  been  selected  to  achieve  the  appropriate 
resolution  of  200  pels  per  inch  for  typewritten  information.  When  information  with  a 
lower  resolution  requirement  is  inserted  into  the  system,  it  would  be  of  value  to  reduce 
the  number  of  pels  taken  in  order  to  reduce  the  number  of  bits  required  for  transmission. 
To  achieve  this,  a number  of  approaches  will  be  investigated.  One  method  would  be 
the  removal  of  alternate  pels  along  the  line  for  each  line  thus  reducing  the  number  of 
pels  taken  by  a factor  of  2.  The  second  approach  would  be  to  delete  adjacent  pels  on 
a line  and  the  following  line  thereby  reducing  by  a factor  of  4 the  number  of  pels  taken. 
To  make  the  necessary  machine  determinations  to  allow  reduction  in  the  number  of 
pels  taken,  the  pel  brightness  statistics  would  be  examined  for  their  area  distribution. 

The  type  of  relationship  to  be  used  for  determination  of  pel  size  would  be  based  on 
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the  variances  determined  by  examination  of  the  image  histogram  taken  at  different 
resolutions.  As  an  example,  consider  figure  A2  with  the  ideal  typewritten  image.  If 
the  number  of  pels  taken  per  page  exceeded  the  resolution  required  by  the  image  con- 
tent, the  A curve  would  remain  virtually  unchanged.  For  resolutions  at  which  the  width 
of  the  B curve  would  decrease,  the  decrease  would  occur  as  a result  of  a higher  number 
of  occurrences  of  pels  with  a full  black  value.  Once  the  information  has  been  normalized, 
the  net  effect  would  be  reduction  in  the  width  of  the  B curve.  Detailed  examination  of 
the  variances  of  the  pel  brightness  statistics  taken  with  different  pel  resolutions  would 
result  in  a measure  of  the  differences  in  the  shape  of  the  histograms.  This  in  turn  could 
be  used  as  a method  of  adjusting  the  pel  size. 


CONTRAST 

With  images  being  taken  in  three  colors  by  the  prescanner,  the  image  with  the 
best  contrast  should  be  selected  for  transmission.  To  determine  whether  the  image  from 
the  red  channel  is  of  higher  contrast  than  the  image  from  the  green,  an  algorithm  must 
be  created  which  will  examine  the  histogram  structure  and  look  for  information  which 
will  identify  this  distinction.  One  possible  method  involves  computing  the  moment  of 
the  histogram  with  respect  to  the  center  of  the  contrast  difference.  Two  important 
parameters  are  expected  to  vary  when  the  color  illumination  is  changed.  First  is  the 
position  in  the  pel  brightness  histogram  of  the  substrate  reflectance;  and  second  is  the 
histogram  location  of  the  average  typewritten  print  reflectance.  Two  facts  are  expected 
when  the  same  image  taken  in  three  different  colors  is  examined.  The  expected  result 
is  the  creation  of  three  different  average  contrast  differences,  and  the  resulting  three 
relative  shapes  of  both  the  B and  the  C curves  of  figure  A2  will  in  fact  be  different. 

If  a centerline  is  erected  midway  along  the  average  contrast  difference  and  the  histogram 
to  the  left  and  to  the  right  for  all  three  colors  is  adjusted  by  normalizing  until  the 
same  average  contrast  difference  occurs  at  each  color,  then  only  the  moment  of  the 
data  with  respect  to  the  centerline  will  be  significant  in  determining  which  of  the  images 
is  the  most  distinctive  in  contrast.  Examples  of  this  type  of  calculation  must  be  pro- 
grammed on  the  frame  store  memory  controller  to  generate  the  conclusions  for  this 
speculation. 


LETTER/PHOTOGRAPH  CONTROL 


One  of  the  important  distinctions  to  be  made  by  the  equipment  before  processing 
information  is  whether  it  is  dealing  with  a photograph  or  with  a letter.  Figures  A2 
and  A3  indicate  the  expected  behavior  of  pel  brightness  histograms  given  typewritten 
and  continuous  tone  images.  The  distinctive  characteristic  of  two  peaks  occurring  in 
the  histogram  of  typewritten  information  may  be  found  in  continuous  tone  imagery. 
However,  a very  distinctive  property  of  typewritten  data  is  the  preponderance  of  white 
which  should  occur  within  the  image.  In  a continuous  tone  image,  in  general,  we  expect 
to  find  far  fewer  white  pels  in  the  total  image.  By  comparing  the  properties  indicated  in 
figures  A2  and  A3,  this  distinction  can  be  observed.  The  algorithm  to  be  generated 
therefore  must  examine  the  number  of  pels  to  the  left  of  the  average  contrast  difference 
centerline  and  compare  against  the  number  of  pels  which  are  to  the  right  of  the  center- 
line.  After  testing  a variety  of  images,  suitable  criteria  for  adjustment  of  this  threshold 
for  determination  should  be  possible. 
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BIT  PRECISION 


One  of  the  important  parameters  to  be  considered  in  reducing  the  number  of  bits 
required  to  transmit  an  image  is  the  number  of  bits  used  to  symbolize  each  pel  in  the 
image.  The  simplest  possible  scheme  that  will  be  evaluated  will  examine  the  activity  of 
the  run  length  statistics  in  each  bit  plane.  The  expectation  is  that  the  lesser  significant 
bits  of  a given  image  will  show  a high  occurrence  rate  for  very  short  runs,  whereas  in  the 
more  significant  bits  there  should  be  a high  occurrence  of  long  runs.  By  examining  this 
activity  in  the  run  length  statistics  for  each  bit  plane,  a threshold  will  be  sought  which 
will  allow  an  automatic  determination  at  what  bit  precision  a particular  image  should  be 
executed.  Since  letter  information  will  ultimately  be  processed  in  binary  configuration, 
the  bit  precision  control  is  intended  to  be  activated  for  continuous  tone  information.  A 
completely  different  technique  will  be  used  for  the  binary  decision  processing  of  letter 
mail. 


COMPRESSION 

From  the  brightness  statistics,  the  run  length  statistics,  and  the  first  derivative 
statistics  it  is  possible  to  calculate  the  entropy  associated  with  each  process.  From  a 
technology  standpoint  this  information  will  be  utilized  in  determining  the  magnitude  of, 
and  therefore  the  boundaries  for,  the  compression  of  data  from  each  of  the  three  tech- 
niques. In  addition  to  this  information,  the  first  derivative  statistics,  the  run  length  sta- 
tistics, and  the  brightness  statistics  will  be  compared  to  determine  which  type  of  coding 
scheme  is  optimum  for  mail  transmission.  Three  techniques  of  coding  which  will  be  eva- 
luated in  this  manner  include  run  length  coding,  delta  modulation,  and  a block  coding 
technique.  As  an  example  of  block  coding,  a Fourier  analysis  technique  looks  very 
promising. 


FILTERING 

The  filter  algorithm  would  be  applied  to  the  image  when  it  is  a letter  and  would 
be  used  to  enhance  the  character  edges.  The  techniques  to  be  examined  for  filtering  in 
two  dimensions  were  reported  in  detail  in  the  first  annual  report. 


NELC  DIGITAL  IMAGE  ANALYZER 
GENERAL  DESCRIPTION 

The  NELC  Digital  Image  Analyzer  (DIA)  is  a 3 1/2-by- 19-inch  rack  mount  unit 
which  is  constructed  via  10000  series  emitter  coupled  logic  (ECL)  on  Augat  multilayered 
wire  wrap  logic  planes.  Photographs  of  the  analyzer  are  shown  in  figures  AS  and  A6.  The 
analyzer  is  designed  to  generate  several  types  of  image  statistics  in  a sequential  manner, 
which  include  pel  brightness  statistics  (PBS),  run  length  statistics  (RLS),  and  first  deriva- 
tive statistics  (FDS).  There  are  two  interfaces  to  the  analyzer;  one  is  the  high-speed 
image  data  input  port  with  all  inputs  ECL  compatible.  At  present  this  interface  will 


Figure  A-5.  Digital  image  analyzer,  top  view 
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accommodate  image  data  from  the  USPS  Large  Drum  Test  Bed  (LDTB)  and  the  NELC 
Video  Transmission  System.  The  second  interface  is  a general-purpose  digital  controller 
interface  whose  inputs  and  outputs  are  TTL  compatible.  This  interface  allows  operation 
of  the  D1A  as  a peripheral  device.  It  is  presently  interfaced  to  the  USPS  Frame  Store 
Memory  Controller  (FSMC).  A simplified  block  diagram  is  shown  in  figure  A7.  The 
image  data  input  to  the  analyzer  is  converted  to  Gray  code,  which  allows  operation  on 
either  binary  or  Gray  code  image  data.  The  mode  selector  selects  from  top  to  bottom 
pel  intensity  statistics,  run  length  statistics,  or  first  derivative  statistics.  The  selected  out- 
put is  used  as  a 6-bit  address  to  a high-speed  ECL  random  access  memory  organized  as 
64  words  by  24  bits  per  word.  Using  this  address,  the  contents  of  the  selected  memory 
location  are  output,  incremented  by  one,  and  returned  to  the  same  memory  location. 
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Figure  A7.  Digital  image  analyzer  simplified  block  diagram. 


MODES  OF  OPERATION 

The  image  analyzer  will  generate  statistics  on  any  6-bit  input  data  format.  How- 
ever, units  currently  interfaced  with  the  analyzer  use  a 6-bit  binary  format.  The  analyzer 
is  capable  of  converting  binary  information  to  Gray  code  in  order  to  investigate  possible 
improvement  in  data  compression.  All  subsequent  modes  discussed  allow  the  use  of 
either  binary  or  Gray  code  data  for  analysis. 

In  the  PBS  mode  the  analyzer  accumulates  the  total  number  of  occurrences  of 
pels  at  each  of  the  64  possible  brightness  levels  throughout  an  entire  image.  The  upper 
left  portion  of  figure  A8  shows  this  operation  pictorially.  Image  data  from  the  sensor  are 
amplified  and  converted  to  digital  format  in  the  A/D  converter.  The  output  is  a 6-bit 
binary  code  with  all  zeros  representing  a black  pel  and  all  ones  representing  a white  pel. 
This  6-bit  code  is  used  as  an  address  to  select  one  of  64  memory  locations  in  the  high- 
speed ECL  random  access  memory.  The  contents  are  read  out  and  incremented  by  one 
in  a high-speed  adder  and  then  stored  back  in  the  same  memory  location.  This  opera- 
tion is  done  on  a pel-by-pel  basis  throughout  the  entire  image.  The  contents  of  the  64 
memory  locations  are  then  read  out  either  manually  from  an  LED  display  or  by  the 
FSMC  for  generation  of  a histogram  or  bar  graph  display  of  the  information. 


j 
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Figure  A8.  D1A  Operating  Modes 


HARDWARE  DESCRIPTION 


Figure  A9  is  a block  diagram  of  the  Digital  Image  Analyzer  (DIA).  There  are  two 
data  sources  input  to  the  data  source  multiplexer,  one  from  the  high-speed  scanner  input 
port  and  one  from  the  digital  controller  interface.  The  selected  binary  data  are  then  fed 
into  the  input  selector  multiplexer  and  the  binary-to-Gray  code  converter.  The  input 
selector  selects  either  binary  or  Gray  code  image  data  for  analysis.  The  mode  selector 
selects  one  of  the  three  types  of  statistics  to  be  accumulated  by  the  analyzer,  which  are 
the  FDS,  RLS,  and  PBS.  The  output  from  the  mode  selector  is  strobed  into  a 6-bit  pipe- 
line register  for  data  resynchronization.  From  this  register  alternate  pels  are  strobed  into 
each  of  the  two  6-bit  data  registers  organized  as  a Ping-Pong  register  whose  outputs  are 
alternately  selected  by  the  address  selector  for  reading  and  writing  data  into  the  random 
access  memory  (RAM).  After  statistics  have  been  gathered,  the  address  selector  selects 
the  interrogate  address  input  for  reading  data  out  of  the  RAM.  There  are  two  sources 
for  the  interrogation  address,  one  from  a manual  entry  from  the  front  panel  and  the 
other  from  the  digital  controller  interface.  The  last  input  to  the  address  selector  is  from 
a control  counter  which  is  used  for  clearing  the  memory  and  also  for  diagnostic  purposes. 
The  64-word  by  24-bit  RAM  is  used  for  accumulation  of  statistics.  The  data  multiplexer 
selects  data  from  one  of  three  sources  for  input  to  the  read  data  register.  They  are  the 
RAM  output  data,  the  write  data  register  output,  and  an  external  24-bit  input  bus,  which 
currently  is  controlled  manually  by  a series  of  switches.  Data  stored  in  the  read  data 
register  are  input  to  the  arithmetic  logic  unit  (ALU),  the  LED  display,  and  the  digital 
controller  interface.  The  ALU  is  capable  of  performing  32  arithmetic  and  logic  functions 
on  two  24-bit  data  words.  The  write  data  register  stores  the  output  information  from 
the  ALU  for  writing  into  memory.  The  LED  display  provides  manual  readout  of  the  con- 
tents of  the  RAM.  The  digital  controller  interface  allows  the  FSMC  to  read  the  contents 
of  the  RAM  and  display  them  in  histogram  form  on  a CRT  display.  The  interface  also 
allows  the  memory  controller  to  transfer  image  data  from  either  the  3-megabit  frame 
store  memory  or  magnetic  tape  to  the  analyzer  for  analysis. 


FRONT  PANEL  CONTROLS 

Figure  A10  is  a diagram  of  the  various  front  panel  controls  on  the  DIA.  On  the 
left  is  a 2-digit  octal  lever  switch  used  for  selection  of  any  one  of  up  to  64  operating 
modes.  See  table  A1  for  the  modes  implemented.  The  next  2-digit  octal  lever  switch 
selects  any  one  of  the  64  memory  locations  for  manual  readout  of  memory  and  for  var- 
ious diagnostic  modes.  The  execute  pushbutton  is  used  to  initiate  the  various  diagnostic 
modes.  The  master  reset  pushbutton  is  used  to  clear  various  portions  of  the  circuitry. 

On  the  right  is  an  8-digit  octal  LED  display  used  to  read  data  from  the  memory.  There 
is  an  additional  mode  which  is  designed  to  check  the  repeatability  or  the  stability  of  an 
image  sensor.  Assuming  that  the  pel  brightness  statistics  were  just  accumulated,  this  new 
subtract  mode  may  be  run  in  which  the  memory  location  is  decremented  by  one  instead 
of  incremented  as  in  the  previous  mode.  If  the  two  images  were  identical,  all  memory 
locations  should  be  decremented  to  exactly  zero.  In  this  way  the  differences  in  an  image, 
from  one  scan  to  the  next,  will  be  shown  by  the  resulting  information  left  in  the  memory 

In  the  run  length  statistics  (RLS)  mode,  the  analyzer  accumulates  totals  of  either 
zero  runs  or  one  runs  in  an  image.  The  middle  left  portion  of  figure  A8  describes  this 


Figure  A9.  DIA,  block  diagram. 


Figure  A10.  Front  panel  controls. 


TABLE  Al.  IMAGE  ANALYZER  MODES. 


Description 


PBS  Binary 

RLS  Binary  0-Runs  BP-1  (LSB) 

RLS  Binary  0-Runs  BP-2 

RLS  Binary  0-Runs  BP-3 

RLS  Binary  0-Runs  BP-4 

RLS  Binary  0-Runs  BP-5 

RLS  Binary  0-Runs  BP -6  (MSB) 

FDS  Binary 

PBS  Binary  Subtract  mode 
RLS  Binary  1-Runs  BP-1 
RLS  Binary  1-Runs  BP-2 
RLS  Binary  1-Runs  BP-3 
RLS  Binary  1-Runs  BP-4 
RLS  Binary  1-Runs  BP-5 
RLS  Binary  1-Runs  BP-6 
Not  used 
PBS  Gray 

RLS  Gray  0-Runs  BP-1 
RLS  Gray  0-Runs  BP-2 
RLS  Gray  0-Runs  BP-3 
RLS  Gray  0-Runs  BP4 
RLS  Gray  0-Runs  BP-5 
RLS  Gray  0-Runs  BP-6 
FDS  Gray 

PBS  Gray  Subtract  mode 
RLS  Gray  1-Runs  BP-1 
RLS  Gray  1-Runs  BP-2 
RLS  Gray  1-Runs  BP-3 
RLS  Gray  1-Runs  BP -4 
RLS  Gray  1-Runs  BP-5 
RLS  Gray  I -Runs  BP-6 
Not  used 

Display  contents  of  selected  register 
Clear  Memory 

Store  contents  of  “A”  bus  in  selected  register 


0-Runs  BP-1 
0-Runs  BP-2 
0-Runs  BP-3 
0-Runs  BP4 
0-Runs  BP-5 

0- Runs  BP-6 

Subtract  mode 

1- Runs  BP-1 
1 -Runs  BP-2 
1 -Runs  BP-3 
1 -Runs  BP4 
1 -Runs  BP-5 
1 -Runs  BP-6 


TABLE  Al.  (Continued) 


Mode 

Description 

43 

Store  contents  of  “A”  bus  in  all  registers 

44 

Continuous  increment  into  selected  register 

45 

Continuous  decrement  into  selected  register 

46 

Not  used 

76 

77 

Analyzer  under  digital  interface  control 

Notes:  PBS  Pel  Brightness  Statistics 
RLS  Run  Length  Statistics 
FDS  First  Derivative  Statistics 


operation.  Data  output  from  the  A/D  converter  are  fed  through  a bit  plane  selector 
since  only  one  bit  stream  at  a time  may  be  operated  on.  The  output  from  the  bit  plane 
selector  is  fed  into  a counter  which  counts  runs  of  either  zeros  or  ones  depending  on  the 
particular  mode  selected.  At  the  end  of  a run,  the  count  contained  in  the  6-bit  counter 
is  used  as  an  address  to  select  one  of  the  64  memory  locations  as  in  the  PBS  mode. 

There  is  the  limitation,  however,  of  only  a 6-bit  counter,  which  means  that  runs  of  length 
greater  than  64  will  have  the  result  that  multiple  runs  are  counted.  This  is  true,  however, 
with  any  run  length  encoding  data  compression  scheme.  For  example,  if  there  was  a run 
of  66,  memory  location  63  and  memory  location  1 would  each  be  incremented.  Note 
that  run  lengths  of  1 through  64  correspond  to  memory  locations  numbered  0 through 
63.  In  the  image  analyzer  there  are  24  individual  modes  to  accumulate  run  length  sta- 
tistics. There  are  six  bit  planes  and  modes  to  accumulate  statistics  on  zero  runs  and  on 
one  runs.  Each  of  these  may  be  accumulated  using  the  binary  code  input  or  Gray  code 
input,  resulting  in  a total  of  24  modes. 

The  first  derivative  statistics  (FDS)  modes  compute  the  absolute  value  of  the  dif- 
ferences between  successive  pels  in  an  image.  The  lower  portion  of  figure  A8  shows  the 
operation  of  the  FDS  modes.  Image  data  from  the  A/D  converter  are  input  to  both  a 
6-bit  storage  register  and  a subtractor.  The  storage  register  contains  the  previous  pel 
value,  which  is  subtracted  from  the  present  value  to  obtain  the  difference.  This  differ- 
ence is  used  then  as  an  address  to  the  64-location  random  access  memory  as  in  the 
previous  modes. 

There  are  several  other  modes  of  operation  for  the  image  analyzer.  One  ot  these 
is  the  display  memory  mode.  In  this  mode  front  panel  switch  inputs  are  used  to  address 
each  of  the  64  memory  locations  to  read  out  the  contents  on  an  8-digit  octal  light- 
emitting  diode  (LED)  display.  This  information  can  also  be  read  out  through  a general- 
purpose  digital  controller  interface  under  program  control.  Other  modes  are  designed  pri- 
marily for  diagnostics:  they  include  loading  one  or  all  memory  locations  from  a manually 
switched  input  bus.  a clear  memory  mode,  and  continuous  count  modes  to  check  the 
arithmetic  logic  unit  and  register  operation. 
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HIGH-SPEED  DATA  INPUT  PORT 


This  interface  is  comprised  of  10  ECL  compatible  differential  signals  transmitted 
over  twisted-pair  lines.  There  are  six  data  inputs,  a clock,  an  enable,  and  a clear  mem- 
ory signal  with  an  echo  output  response  after  the  memory  is  cleared.  The  maximum 
clock  rate  to  the  analyzer  is  approximately  21  MHz.  Currently  the  analyzer  is  interfaced 
via  this  data  input  port  to  the  USPS  LDTB  and  to  the  VTS. 


DATA  INPUT  SELECTION  AND  CONVERSION  UNIT 

A block  diagram  of  this  circuitry  is  shown  in  figure  All.  The  data  source  multi- 
plexer selects  image  data  from  either  the  high-speed  scanner  interface  or  the  digital  con- 
troller interface.  The  selected  data  are  then  fed  into  an  input  selector  multiplexer  and 
to  the  binary-to-Gray  code  converter.  The  input  selector,  which  is  controlled  by  the 
mode  switch,  selects  either  binary  or  Gray  code  image  data  for  analysis. 


FIRST  DERIVATIVE  STATISTICS  UNIT 


The  first  derivative  statistics  unit  computes  the  absolute  value  of  the  difference 
between  successive  pel  brightness  levels.  The  block  diagram  of  the  circuitry  is  shown  in 
figure  A12.  There  are  two  6-bit  data  registers  which  contain  at  any  given  time  the  two 
most  recent  pel  brightness  values.  Outputs  from  these  registers  are  fed  into  both  a com- 
parator and  a subtractor  unit.  The  comparator  decides  which  value  is  larger,  and  the  out- 
put from  the  comparator  tells  the  subtractor  to  subtract  A-B  or  B-A  to  obtain  the  abso- 
lute value.  The  output  from  the  subtractor  then  is  used  as  a 6-bit  address  to  the  RAM 
for  statistics  accumulation.  The  basic  timing  diagram  shown  in  figure  A13  illustrates  the 
operation  of  these  circuits.  At  time  interval  A , registers  A and  B contain  pel  intensity 
values  of  16  and  3,  respectively.  The  output  from  the  comparator  is  such  that  A is 
greater  than  B,  and  this  control  is  used  to  set  up  an  A-B  subtract  mode.  The  next  clock 
pulse  will  load  the  output  from  the  subtractor  into  the  pipeline  register  shown  in  the  block 
diagram  in  figure  A9.  At  time  interval  B , registers  A and  B contain  values  10  and  32, 
respectively.  In  this  case  the  comparator  output  indicates  that  B is  greater  than  A and 
tells  the  subtractor  to  subtract  A from  B;  thus,  on  the  next  clock  pulse  the  value  22  is 
loaded  into  the  pipeline  register.  In  this  way  statistics  are  accumulated  on  the  number  of 
occurrences  of  pel-to-pel  differences  of  magnitude  0 to  63. 


] 


RUN  LENGTH  STATISTICS  UNIT 

The  run  length  statistics  modes  are  designed  to  accumulate  the  number  of  occur- 
rences of  runs  varying  in  length  from  1 to  64  as  they  occur  on  a particular  bit  plane 
throughout  an  image.  Only  runs  of  ones  or  runs  of  zeros  may  be  accumulated  for  a 
particular  image.  A block  diagram  of  the  run  length  statistics  unit  is  shown  in  figure  A 14 
Inputs  to  this  unit  include  the  6-bit  binary  or  Gray  code  image  data,  3-bit  plane  control 
lines  which  select  one  of  the  six  bit  planes,  and  a control  line  selecting  accumulation  of 
zero  or  one  runs  throughout  the  image.  The  selected  bit  plane  output  is  fed  into  a data 
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Figure  All.  Data  input  selection  and  conversion  unit. 
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Figure  A 12.  First  derivation  statistics  unit. 
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Figure  A 13.  First  derivative  statistics  timing  diagram. 
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change  pulse  generator,  which  generates  a pulse  each  time  the  data  changes,  whether  it  be 
from  one  to  zero  or  zero  to  one.  The  multiplexer  output  is  also  fed  into  clock  enable 
logic  which  enables  the  data  change  pulse  onto  the  run  length  clock  line  at  the  end  of 
the  selected  run.  A timing  diagram  in  figure  A15  illustrates  the  operation  of  the  circuit. 
Assuming  a mode  was  selected  to  count  numbers  of  one  runs,  at  time  interval  A , the 
selected  bit  plane  data  output  data  change  from  zero  to  one,  initiating  a run  of  ones. 
Three  clock  periods  later  at  time  B the  data  change  from  one  to  zero.  The  resulting 
data  change  pulse  is  enabled  onto  the  run  length  clock  line,  loading  the  present  contents 
of  the  run  length  counter,  which  in  this  case  is  two,  into  the  pipeline  register  for  statis- 
tics accumulation.  Note  that  run  lengths  of  1 through  64  are  counted  in  memory  loca- 
tions 0 to  63,  which  results,  in  this  case,  in  a run  of  length  3 being  counted  in  memory 
location  2. 


ADDRESS  INPUT  SELECTOR 

The  address  input  selector  shown  in  figure  A16  is  effectively  a 5:1  multiplexer 
which  selects  one  of  five  address  sources  for  the  RAM.  The  first  two  inputs  are  from 
a Ping-Pong  data  register  whose  inputs  come  from  the  pipeline  register.  Statistics  data 
coming  from  the  pipeline  register  are  input  alternately  into  data  register  A and  then  data 
register  B.  The  timing  of  these  two  registers  will  be  shown  later  in  a timing  diagram. 

The  third  input  to  this  address  multiplexer  is  from  a control  counter  which  is  used  for 
clearing  memory  and  for  various  diagnostic  modes  in  the  analyzer.  The  fourth  address 
input  is  from  a 2-digit  octal  lever  switch  on  the  front  panel  which  is  used  for  manual 
readout  of  the  contents  of  the  64  memory  locations  on  the  LED  display.  The  last  input 
is  from  the  address  register  in  the  digital  controller  interface.  This  register  is  used  when 
the  DIA  is  under  program  control  for  transfer  of  data  from  the  analyzer  to  a digital 
controller. 


RANDOM  ACCESS  MEMORY  AND  ARITHMETIC  LOGIC  UNIT 

The  architecture  of  the  RAM  and  ALU  is  designed  as  a general-purpose  digital 
computer  central  processing  unit  with  a 24-bit  data  bus  and  64  general-purpose 
accumulator/index  registers.  In  the  DIA,  however,  this  circuitry  is  hardwired  rather  than 
software  programmed  to  perform  the  functions  required  by  the  analyzer.  A block  dia- 
gram of  this  circuitry  is  shown  in  figure  A 17.  The  memory  is  a 64-word  by  24-bit  RAM 
with  a 25-ns  read/modify/write  cycle  time.  The  read  cycle  time  and  write  cycle  time  are 
12  ns  and  18  ns,  respectively.  The  read  data  register  has  three  sources,  selected  by  the 
data  multiplexer,  which  are  the  RAM  output,  an  external  24-bit  data  bus,  and  the  write 
data  register  outputs.  The  write  data  register  holds  the  output  from  the  ALU  for  writing 
into  memory.  Tne  ALU  performs  16  arithmetic  and  16  logical  functions  on  the  A and/or 
B data  inputs.  It  is  implemented  with  full  lookahead  carry  logic  to  permit  high-speed 
operation.  A 24-bit  addition  can  be  performed  in  about  18  ns.  The  A input  is  from  the 
read  data  register  and  the  B input  is  currently  hardwired  to  a plus  1 for  statistics  genera- 
tion. The  operation  of  these  circuits  and  of  the  Ping-Pong  data  register,  described  earlier, 
is  shown  in  the  timing  diagram  in  figure  A18.  Data  output  from  the  pipeline  register  and 
its  associated  data  clock  are  the  inputs  to  this  section;  phase  2 clock  is  generated  from 
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Figure  A14.  Run  length  statistics  unit. 
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Figure  A15.  Run  length  statistics  tinting  diagram. 


the  data  clock.  Pel  information  from  any  of  the  analyzer  operation  modes  is  input  to  the 
Ping-Pong  data  registers  A and  B.  Every  other  pel  is  stored  in  data  register  A and  the 
alternating  pels  are  stored  in  data  register  B.  The  address  mux  control  selects  the  appro- 
priate data  register  output  to  be  enabled  onto  the  RAM  address  lines. 

The  operation  of  this  circuit  will  be  described  by  loading  of  pel  data  Pj  into  data 
register  A,  reading  the  contents  of  memory  location  specified  by  Pj,  inc’-ementing  the 
contents,  and  storing  them  back  into  the  memory  at  location  Pj.  At  time  A Pj  is 
loaded  into  Ping-Pong  register  A,  the  output  of  which  is  enabled  onto  the  RAM  address 
lines. 

After  the  memory  access  time,  which  is  the  time  interval  A to  B , the  contents 
of  memory  location  P;  are  loaded  into  the  read  data  register.  Also  at  this  time,  the 
incremented  contents  of  memory  location  Pj-1  are  loaded  into  the  write  data  register  for 
writing  into  memory.  At  time  B the  address  multiplexer  control  is  switched  to  enable 
the  contents  of  Ping-Pong  register  B onto  the  RAM  address  lines  in  order  to  write  the 
incremented  contents  of  location  P;-l  into  memory.  At  time  C the  next  pel  informa- 
tion Pj+1  is  loaded  into  Ping-Pong  register  B,  which  becomes  the  next  effective  memory 
address.  At  time  D the  contents  of  Pj+1  are  loaded  into  the  read  data  register  which 
previously  contained  the  contents  of  Pj.  Also,  at  the  same  time,  the  incremented  con- 
tents of  Pj  present  on  the  ALU  outputs  are  loaded  into  the  write  data  register  for  storing 
in  memory  during  the  interval  D to  E , completing  the  processing  of  pel  data  Pj. 

DIGITAL  CONTROLLER  INTERFACE 

The  digital  controller  interface  allows  the  DIA  to  be  used  by  any  digital  con- 
troller, such  as  the  USPS  FSMC,  as  a peripheral  device.  When  the  analyzer  front  panel 
mode  selector  switch  is  in  position  77,  the  DIA  is  under  remote  control.  This  allows  the 
controlling  device  to  do  any  of  the  statistics  operations  and  to  interrogate  the  contents 
of  the  64  memory  locations  for  processing  purposes.  A block  diagram  of  this  interface 
is  shown  in  figure  A 19.  The  interface  consists  of  13  TTL  compatible,  differential  signals 
transmitted  over  twisted-pair  lines.  Eight  of  these  signals  comprise  a bidirectional  data 
bus  which  may  transmit  data  to  or  from  the  DIA.  The  remaining  five  signals  are  controls 
from  the  controlling  device  to  the  analyzer,  which  consist  of  function  controls  and  device 
address  lines.  There  are  two  sources  of  data  that  may  be  transmitted  from  the  DIA  to  the 
controlling  device.  The  first  is  a status  line  which  indicates  whether  or  not  the  front  panel 
mode  control  switch  is  in  position  77.  The  other  is  the  24-bit  data  bus  from  the  read 
data  register.  Since  the  bidirectional  data  bus  is  only  8 bits  wide,  the  24-bit  data  bus 
must  be  enabled  8 bits  at  a time  onto  this  bus.  Data  received  by  the  analyzer  over  the 
8-bit  bidirectional  data  bus  are  stored  in  one  of  three  registers.  The  address/command 
register  is  used  primarily  to  address  the  memory  for  interrogation.  The  two  low-order 
bits  are  used  as  a byte  select  to  enable  8 of  the  24  bits  onto  the  data  bus  at  a time. 

The  high-order  6 bits  are  used  to  address  one  of  the  64  memory  locations  in  the  RAM. 

The  mode  control  register  is  used  when  the  analyzer  is  under  remote  control  to  select 
one  of  the  operating  modes  for  statistics  gathering.  The  image  data  register  is  used  when 
inputting  data  from  the  digital  controller  to  the  DIA  for  analysis.  Contained  in 
appendix  A (to  this  appendix)  is  a detailed  description  and  user  guide  for  this  interface. 
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BUILT-IN  TEST  EQUIPMENT 
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Incorporated  in  the  DIA  is  a circuit  which  may  be  used  to  test  the  analyzer  oper- 
ation. A block  diagram  of  the  circuitry  is  shown  in  figure  A20.  It  is  driven  by  a voltage 
controlled  oscillator  with  adjustable  frequency  whose  range  is  approximately  10  to 
25  MHz.  Also  included  is  a programmable  eight-position  switch  which  may  be  used  to 
select  a desired  count  sequence  for  data  generation.  Data  are  generated  by  a 6-bit 
counter  which  generates  a binary  count  sequence.  The  variable  clock  rate  allows  testing 
of  the  analyzer  at  speeds  up  to  25  MHz. 


POWER  SUPPLY 

The  power  supply  for  the  image  analyzer  is  a Lambda  Electronics  Co  5 1 /4-by- 
1 9-inch  rackmount  unit  with  the  following  outputs. 

minus  5.2  volts  at  27  amperes 
minus  2 volts  at  9 amperes 
plus  5 volts  at  9 amperes 

At  present  the  power  requirements  for  the  image  analyzer  are: 

minus  5.2  volts  at  8 amperes 
minus  2 volts  at  5 amperes 
plus  5 volts  at  3 amperes 

RESULTS 

Presented  in  this  section  is  a sample  of  the  type  of  data  that  will  be  taken  during 
the  remainder  of  this  program.  To  obtain  the  results  shown  here,  the  Video  Transmission 
System  has  been  used  in  place  of  the  USPS  scanner  test  bed  output,  since  the  new  test 
bed  is  now  under  construction.  The  configuration  of  the  system  is  shown  in  figure  A21. 
A standard  television  camera  is  used  to  scan  a page  of  information,  the  output  of  which 
is  stored  in  the  Video  Transmission  System  frame  store  memory.  The  picture  is  also 
displayed  on  a CRT  display  associated  with  the  Video  Transmission  System.  Image  data 
are  then  sent  to  the  DIA  >r  analysis.  Once  the  statistics  have  been  taken,  the  USPS 
FSMC  is  used  to  interrogate  the  DIA,  transferring  the  information  from  the  DIA  to  the 
FSMC  for  display  in  both  tabular  form  on  the  Tektronix  CRT  display  terminal  and  histo- 
gram form  on  the  FSMC  CRT  display.  Statistics  information  in  tabular  form  may  be 
transferred  to  the  Tektronix  hard-copy  unit  for  hard-copy  output. 

Shown  in  figure  A22  are  the  two  samples  used  to  demonstrate  the  statistics  out- 
puts. One  sample  of  typewritten  material  and  one  sample  of  a continuous  tone  photo- 
graph were  used.  The  television  camera  was  set  up  to  scan  these  images  at  a resolution 
which  approximates  the  USPS  requirements  of  200  by  200  pels  per  inch.  However,  the 
television  camera,  with  an  aspect  ratio  of  3 to  4,  cannot  scan  with  a square  resolution. 
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Figure  A19.  Digital  controller  interface. 
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Figure  A20  Built-in  test  equipment. 
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Therefore,  the  data  presented  here  should  be  regarded  as  representative  of  data  which 
will  be  taken  when  the  new  scanner  test  bed  is  completed. 


1 


The  PBS  and  FDS  statistics  are  shown  in  figure  A23  for  the  two  samples.  From 
the  PBS  statistics  it  can  be  seen  that  the  general  trend  is  in  agreement  with  the  idealized 
figure  presented  in  the  Prescanner  Image  Analysis  section. 

The  PBS  statistics  for  the  two  images  show  the  general  differences  expected  for 
typewritten  material  versus  continuous  tone  picture  information.  The  first  derivative 
statistics,  however,  are  almost  identical  for  the  two  pictures.  These  statistics  in  tabular 
form  output  from  the  Tektronix  hard-copy  unit  are  presented  in  appendix  B (to  this 
appendix). 

Figures  A24  and  A25  show  the  RLS  histograms  for  the  two  samples.  In  each 
figure  the  histograms  represent  the  total  number  of  zero  runs  occurring  in  the  images  in 
all  six  bit  planes.  The  data  in  tabular  form  are  contained  in  appendix  B.  As  can  be  seen 
in  these  histograms,  there  is  a periodicity  that  is  yet  unexplained.  It  appears  that  at 
every  fourth  location  there  is  a much  larger  number  than  in  the  rest,  indicating  that 
most  zero  runs  occur  with  lengths  of  1,  5,  9,  13,  etc.  The  cause  of  this  abnormality  will 
be  resolved  in  the  next  report. 

The  DIA  has  been  tested  in  operation  using  the  built-in  test  equipment  and  has 
been  determined  to  operate  up  to  a maximum  of  20.4  MHz,  closely  approaching  the  de- 
sign goal  of  21  MHz.  The  interfaces  from  the  DIA  to  the  FSMC,  to  the  scanner  test  bed 
and  to  the  Video  Transmission  System  all  operate  satisfactorily. 


CONCLUSIONS  AND  SUMMARY 

The  image  analyzer  is  operating  in  all  performance  modes  as  planned.  The  modes 
available  include: 

• Pel  Brightness  Statistics  (PBS) 

• First  Derivative  Statistics  (FDS) 

• Run  Length  Statistics  (RLS) 

Binary  of  Gray  code 

One  of  six  bit  planes  selectable 
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Figure  A24.  Run  length  statistics,  typewritten  sample  1 
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Figure  A25.  Run  length  statistics,  continuous  tone  sample  2. 
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The  analyzer  is  compatible  with  two  interfaces.  The  high-speed  data  input  port 
can  accept  6-bit  pel  data  words  at  a rate  of  20.4  megapels  per  second.  A general-purpose 
digital  controller  interface  allows  analyzer  operation  as  a peripheral  device.  Through  this 
interface  devices  such  as  the  Frame  Store  Memory  Controller  can  either  transmit  image 
data  for  analysis  or  receive  analysis  results  for  processing  and  display. 

A very  cursory  examination  of  the  first  system  results  from  the  analyzer  indicates 
that  the  pel  brightness  statistics  are  in  agreement  with  the  ideal  image  model  discussed 
in  the  Prescanner  Image  Analysis  section. 

The  preceding  discussions  on  prescanner  image  analysis  were  provided  to  orient 
the  reader  to  the  direction  of  the  pending  research.  The  supporting  computational  tech- 
niques will  be  developed  during  the  next  reporting  period.  It  should  be  remembered  that 
the  purpose  of  the  proposed  techniques  presented  is  to  reduce  the  total  number  ot  bits 
of  information  that  must  be  transmitted  to  present  the  information  at  the  receiving 
station  in  satisfactory  quality.  The  techniques  being  explored  will  in  no  way  affect  the 
types  of  compression  coding  which  can  be  applied  to  the  resulting  data. 

PLANNED  FUTURE  NELC  ACTIVITIES 

A complete  set  of  statistics  will  be  generated  for  a group  of  images  including  type- 
written, handwritten,  and  continuous  tone  photographs.  These  images  will  be  scanned 
with  a Fairchild  CCD121  imager,  digitized,  and  stored  on  magnetic  tape  for  the  analyses. 

Using  these  statistics,  a development  will  begin  to  generate  the  various  algorithms 
required  to  set  up  the  main  scanner  controls  in  an  electronic  message  input  terminal. 

If  a need  for  the  high  data  rate  appears  to  exist,  an  attempt  will  be  made  to 
increase  the  maximum  operating  speed  of  the  image  analyzer  to  the  design  goal  of 
21  megapels  per  second.  This  will  be  dependent  on  the  architecture  of  the  new  RCA 
tracking  imager  device. 


APPENDIX  A (TO  TR  2020  APPENDIX  A): 
DIGITAL  CONTROLLER  INTERFACE  DESCRIPTION 


INTRODUCTION 

This  is  a description  of  that  portion  of  the  Digital  Image  Analyzer  (DIA)  which 
allows  a general-purpose  digital  controller  such  as  the  USPS  Frame  Store  Memory  Con- 
troller (FSMC)  to  use  the  DIA  as  a peripheral  device. 

All  numerical  constants  used  are  in  octal  notation  unless  otherwise  specified. 

INTERFACE  CONNECTOR  AND  SIGNAL  DESCRIPTION 

There  are  13  TTL  differential,  twisted-pair  signal  lines  comprising  this  interface. 
Eight  of  these  are  a bidirectional  data  bus,  four  are  control  lines,  and  one  is  a strobe 
line.  They  are  defined  by  connector  pin  number,  signal  name,  and  function,  as  follows 


Connector  Pin 

Signal  Name 

+ 

P01  P14 

BDBO  (LSB)> 

+ 

P02  PIS 

BDB1 

+ 

P03  PI  6 

BDB2 

+ 

P04  PI  7 

BDB3 

► 8-bit  bidirectional  data  bus 

+ 

P05  PI  8 

BDB4 

+ 

P06  PI  9 

BDB5 

+ 

P07  P20 

BDB6 

+ 

P08  P21 

BDB7  (MSB) J 

+ 

P09  P22 

DAO  (LSB)  1 

1 

+ 

P10  P23 

t 

DAI  (MSB), 

^ Device  to  DIA 

+ 

PI  1 P24 

FCO  (LSB)  'j 

+ 

h Interface  function  control 

PI  2 P25 

FC1  (MSB) J 

to  DIA 

+ 

PI  3 P26 

STB 

Strobe  to  DIA 
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BIDIRECTIONAL  DATA  BUS  BDB7  - BDBO 

Data  transmitted  from  the  digital  controller  to  the  DIA  consist  of  either  RAM 
address,  mode,  command,  or  image  information,  depending  on  the  Function  Control  code 
FC1-FC0.  Data  transmitted  from  the  DIA  to  the  digital  controller  will  consist  of  either 
image  statistics  information  or  the  front  panel  mode  switch  setting. 


DEVICE  ADDRESS  DAI  - DAO 

The  DIA  device  address  is  DA1-DA0=01.  This  code  must  be  present  on  these 
lines  for  every  I/O  transfer  to  or  from  the  analyzer. 


FUNCTION  CONTROL  FC1  - FCO 


The  four  possible  Function  Control  codes  are  described  as  follows: 


FC1=FC0 

00 


01 


02 


03 


Function 

This  code  enables  the  Strobe  to  clock  an 
8-bit  word  into  the  DIA  Address  Register 
(AR)  as  received  from  the  digital  controller. 

This  code  enables  the  Strobe  to  clock 
an  8-bit  word  into  the  analyzer  Mode 
Control  Register  (MCR). 

This  code  enables  the  Strobe  to  clock  a 
6-bit  word  (BDB5-BDB0)  into  the  DIA 
Image  Input  Register  (HR) 

This  code  enables  an  8-bit  byte  of  data  onto 
the  Bidirectional  Data  Bus  for  transmission 
to  the  digital  controller.  The  digital  controller 
must  disable  the  transmitters  on  the  Bidirectional 
Data  Bus  before  this  Function  Code  is  transmitted 
to  the  DIA  to  prevent  bus  contention. 


I 


STROBE  STB 

This  Strobe  is  used  to  clock  data  into  the  various  registers  in  the  digital  controller 
interface. 
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INTERFACE  REGISTER  DESCRIPTION 


Address  Register  AR7-AR0 


LSB 

1 0 


Address/Command 

Select 


Byte/Control 

Select 


The  primary  purpose  of  this  register  is  to  address  one  of  three  8-bit  bytes  in 
one  of  the  64  (decimal)  words  of  the  RAM  in  the  D1A  for  interrogation  by  the  digital 
controller.  This  register  is  also  used  to  generate  various  commands  to  the  analyzer  and 
to  interrogate  the  analyzer  front  panel  mode  control  switch  setting. 

The  Byte/Control  Select  bits  determine  which  of  these  functions  is  to  be  per- 
formed in  the  following  manner: 


AR1-AR0 


AR7-AR2 


Function 

Selects  command  mode  and  allows  interrogation 
of  the  front  panel  mode  control  switch  setting. 
The  analyzer  commands  are  decoded  as  follows, 
using  bits  AR7-AR2  of  the  Address  Register: 

Function 

NOP  - no  operation. 

Data  Available  - must  be  set  while 
image  data  are  being  transmitted  to 
the  D1A  by  a digital  controller  for 
analysis. 

Master  Reset  - also  clears  the  Address 
Register. 

Execute  - used  to  initiate  certain  modes 
of  analyzer  operation.  Modes  requiring 
the  Execute  command  are  described  in 
the  Mode  Control  Register  section. 
Address  Register  must  be  cleared  (or 
contents  changed)  between  sucessive 
Execute  commands. 


04-77 


Not  used. 
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For  interrogation  of  the  front  panel  mode  control 
switch  setting,  the  Function  Control  lines  must  be 
FC1-FC0=03.  A 1-bit  code  is  then  enabled  onto 
the  Bidirectional  Data  Bus  line  BDBO.  This  code 
is  “1”  if  77  is  entered  via  the  switch  and  “0”  for 
all  other  switch  settings.  This  setting,  77  is  re- 
quired for  the  DIA  to  receive  commands  from  or 
transmit  data  to  the  digital  controller.  Here,  AR7- 
AR2  are  “don’t  care.” 

01  When  FC1-FC0=03,  the  most  significant  8-bit  byte 
of  the  24-bit  memory  word  addressed  by  bits  AR7- 
AR2  is  enabled  onto  the  Bidirectional  Data  Bus  for 
transmission  to  the  digital  controller. 

02  When  FC1-FC0=03,  the  middile  8-bit  byte  of  the 
24-bit  memory  word  addressed  by  bits  AR7-AR2 
is  enabled  onto  the  Bidirectional  Data  Bus  for 
transmission  to  the  digital  controller. 

MODE  CONTROL  REGISTER  MCR7-MCR0 

Before  image  data  are  transmitted  to  the  DIA  for  analysis,  the  Mode  Control 

Register  (MCR)  must  be  loaded  with  the  appropriate  code  for  the  desired  analysis  mode. 

The  operating  modes  for  the  DIA  are  as  follows: 


MCR7-MCR0 

Mode  Description 

00 

PBS  Binary. 

01 

RLS  Binary  0-runs  BP-1  (LSB) 

02 

RLS  Binary  0-runs  BP-2 

03 

RLS  Binary  0-runs  BP-3 

04 

RLS  Binary  0-runs  BP-4 

05 

RLS  Binary  0-runs  BP-5 

06 

RLS  Binary  0-runs  BP-6  (MSB) 

07 

FDS 

10 

PBS  Binary  Subtract  mode 

11 

RLS  Binary  1-runs  BP-1 

12 

RLS  Binary  1-runs  BP-2 

13 

RLS  Binary  1-runs  BP-3 

14 

RLS  Binary  1-runs  BP-4 

15 

RLS  Binary  1-runs  BP-5 

16 

RLS  Binary  1-runs  BP-6 

17 

Not  used 

20 

PBS  Gray  Code 

21 

RLS  Gray  Code  0-runs  BP-1 

22 

RLS  Gray  Code  0-runs  BP- 2 
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MCR7-MCR0 

Mode  Description 

23 

RLS  Gray  Code 

0-runs 

BP-3 

24 

RLS  Gray  Code 

0-runs 

BP-4 

25 

RLS  Gray  Code 

0-runs 

BP-5 

26 

RLS  Gray  Code 

0-runs 

BP-6 

27 

FDS 

30 

PBS  Gray  Code 

Subtract  mode 

31 

RLS  Gray  Code 

1-runs 

BP-1 

32 

RLS  Gray  Code 

1-runs 

BP-2 

33 

RLS  Gray  Code 

1 -runs 

BP-3 

34 

RLS  Gray  Code 

1 -runs 

BP-4 

35 

RLS  Gray  Code 

1 -runs 

BP-5 

36 

RLS  Gray  Code 

1 -runs 

BP-6 

37 

Not  used 

40  Read  contents  of  24-bit  word  of  RAM 
addressed  by  AR7-AR2.  LED  display 
is  enabled  by  this  code. 

41  Clear  all  64  words  of  RAM.  Execute 
command  needed. 

42  Store  contents  of  external,  manually 
switched  data  bus  in  memory  location 
selected  by  AR7-AR2.  Execute  command 
needed. 

43  Store  contents  of  external,  manually 
switched  data  bus  in  all  memory  lo- 
cations. Execute  command  needed. 

44  Continuous  increment  of  contents  of 
memory  location  selected  by  AR7-AR2. 
Execute  command  needed  to  start.  Mas- 
ter reset  command  needed  to  stop. 

45  Continuous  decrement  of  contents  of 
memory  location  selected  by  AR7-AR2. 
Execute  command  needed  to  start.  Mas- 
ter reset  command  needed  to  stop. 

46-77  Not  used. 
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INTRODUCTION 


The  USPS  image  acquisition  system  requires  a document  scanner  section  which 
includes  the  paper  handler,  the  electronic  imager,  the  illumination  source,  and  the  optics 
assembly.  The  output  from  the  acquisition  system  exists  in  the  form  of  high-speed, 
sampled-data  electrical  signals.  The  video  output  rate  is  84  megasamples  per  second.  This 
rate  can  be  divided  into  four  data  streams  at  21  megasamples  per  second,  or  eight  data 
streams  at  10.5  megasamples  per  second  each.  The  data  stream  or  streams  at  this  point 
are  electrically  preprocessed,  if  desired,  and  are  converted  to  digital  equivalents  for  each 
sample  (see  fig  B 1 ). 

The  information  at  this  point  is  both  volatile  and  sequential.  The  serial  streams  of 
image  samples  emerge  one  after  another  as  the  scanners  discharge  the  results  of  acquiring 
a single  line  of  optical  data.  This  is  true  whether  the  imager  is  a line  imager  or  an  area 
imager.  Once  the  streams  are  discharged,  the  image  acquisition  and  electrical  pre-processing 
subsystems  have  no  access  to  adjacent  samples  for  further  processing,  manipulation,  or 
retiming  for  transmission  unless  there  is  memory. 

Some  small  “scratch  pad”  memory,  even  as  much  as  two  to  four  lines  of  image 
data  (1800  to  7200  pels  by  6 bits)  may  be  contained  in  the  preprocessor  circuitry  and 
the  prescan  image  analyzer.  However,  for  significant  memory  capacity  to  perform  not 
only  developmental  investigations  but  actual  on-line  image  acquisition  and  transmission,  a 
large  “frame  store”  memory  will  be  required. 

This  report  describes  the  architecture  and  capabilities  of  an  experimental  frame 
store  memory  and  its  associated  memory  controller  developed  at  NELC  for  Postal  Service 
investigations. 


RELEVANCE  TO  MILITARY  APPLICATIONS 

The  Frame  Store  Memory  and  Memory  Controller  have  high  relevance  to  military 
applications.  Although  the  present  application  is  image  video  storage,  manipulation,  and 
retrieval,  the  high  speed  and  wide  work  width  can  be  applied  to  voice  and  sonar  frequency 
spectrum  analysis,  correlation,  and  event  recording  of  digitized  sampled  data  at  a band- 
width up  to  5 megahertz. 


MEMORY  CHARACTERISTICS 

Postal  Service  goals  require  the  acquisition  of  image  data  at  the  aforementioned 
rate  of  84  megasamples  per  second.  Previous  investigations  at  NELC  have  led  to  the 
conclusion  that  2^,  or  64,  levels  of  data  are  adequate  for  the  acquisition  and  display  of 
continuous  tone  images.  The  product  of  the  84  megasamples  per  second  times  the  6 bits 
per  sample  defines  the  input  data  rate  for  the  frame  store  memory  at  504  megabits  per 
second. 

Although  not  a conclusive  fact  for  this  program,  previous  work  at  NELC  has 
indicated  that  a resolution  of  200  by  200  picture  elements  (pels)  in  the  original  picture 
image  is  adequate  for  continuous  tone  photographs.  This  yields  a requirement  for  a 
storage  capacity  of  40  000  pels  per  square  inch.  When  multiplied  by  the  6 digits  per 
pel,  the  memory  capacity  becomes  240  000  bits  per  square  inch.  From  these  calcu- 
lations it  can  be  seen  that  a total  capacity  of  22.44  megabits  will  be  required  to  store 
the  total  image  data  for  an  8*/2-by-l  1-inch  page  of  copy. 
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In  this  manner  the  acquisition  rate  and  total  capacity  for  a frame  store  memory 
for  Postal  Service  applications  have  been  defined.  The  next  task  is  to  equate  these 
requirements  to  the  availability  of  reliable,  low-cost,  off-the-shelf  memory  systems  which 
will  satisfactorily  perform  in  this  application.  It  is  highly  desirable,  if  not  mandatory  for 
the  developmental  system,  that  the  memory  have  random  access  memory  (RAM)  capa- 
bility. Future  production  equipments  may  utilize  less  expensive  serial  memories;  however, 
they  are  not  suitable  for  experimental  investigations.  Low-cost  memories  meeting  this 
RAM  requirement  are  metal  oxide  silicon  (MOS)  dynamic  devices.  At  the  time  of  pur- 
chase, dynamic  MOS  RAMs  had  a read  or  write  cycle  time  of  0.5  - 1 microsecond 
(plus  about  2%  for  refresh). 

Since  these  memory  rates  are  slower  than  the  digitized  video  acquisition  rate, 
some  tradeoffs  in  the  architecture  of  the  frame  store  memory  are  required.  In  order 
to  accommodate  the  acquired  incoming  image  and  the  required  output  refresh  rate 
(when  the  memory  is  used  to  display  the  acquired  images),  the  memory  system  processes 
wider  words  at  lower  rates.  An  explanation  of  how  the  parameters  are  related  is  given 
in  the  next  section. 

The  considerations  in  the  tradeoff  analysis  include  Postal  Service  goals;  available, 
low-risk  hardware;  and  cost  constraints.  The  tradeoff  defines  a memory  system  having 
the  basic  characteristics  shown  in  table  B 1 . 


TABLE  Bl.  Frame  Store  Memory  Characteristics. 


Number  of  bits 
Word  width 
Read  access  time 
Read/write  cycle  time 


3 145  728 

48  bits 
450  ns 
650  ns 


ARCHITECTURAL  TRADEOFFS 

The  storage  required  for  a complete  page  of  information,  meeting  the  Postal 
Service  speed  and  resolution  requirements,  is  a total  of  3.74  million  video  samples  of 
6 bits  each  at  the  rate  of  84  million  video  samples  per  second.  In  its  simplest  form 
this  would  amount  to  a 3.74-megaword  by  6 bit  memory  having  a write  cycle  time  of 
less  than  1 2 nanoseconds.  A memory  organized  in  the  above  fashion  is  not  an  efficient 
solution.  However,  the  desired  results  can  be  achieved  by  utilizing  a different  memory 
architecture  and  a scheme  of  demultiplexing.  When  the  video  information  is  arriving 
at  1 1.9  nanoseconds  per  sample,  it  can  be  considered  to  be  a multiplexed  data  stream. 

A demultiplexing  operation  would  separate  the  data  into  a wider  but  slower  data  path. 
Demultiplexing  is  accomplished  by  saving  r\  consecutive  video  samples  (r?  > 1)  in  a 
register  of  length  equal  to  6rj  bits  (6  bits  per  pel).  The  resulting  data  words  can  then 
be  handled  by  subsequent  logic  at  “ megawords  per  second.  For  example,  if  t?=2, 
then  the  84  megapel  per  second  video  data  would  be  converted  to  42  megaword  per 
second  data  with  each  word  containing  2 pels,  or  1 2 bits.  The  eventual  choice  of  a 
value  for  77  is  determined  by  the  video  rate  and  the  available  MOS  RAM  cycle  times. 

There  are  still  other  factors  affecting  the  eventual  memory  architecture.  These  are 

the  individual  memory  devices  used  to  implement  the  memory  system,  refresh  requirements, 

and  the  required  support  hardware. 


At  the  time  the  memory  system  was  procured,  the  state-of-the-art  memory  device 
was  an  MOS  dynamic  RAM  organized  as  4k  words  by  1 bit.  The  operating  speed  of  the 
typical  4k  memory  chip  was  in  the  600-900-nanosecond  region,  with  faster  chips  avail- 
able at  premium  cost.  An  additional  factor  to  be  considered  in  selection  of  a memory 
system  architecture  is  the  fact  that  industry  has  prepackaged  and  offers  on  an  off-the- 
shelf  basis  memory  systems  organized  in  multiples  of  8-bit  words.  By  examining  table 
B2,  it  can  be  seen  how  an  increase  in  the  multiplex  ratio  to  64  produces  a memory  system 
384  bits  wide  and  achieves  the  required  speed  reduction  with  available  devices.  The 
complete  memory  system  would  therefore  be  65k  words  by  384  bits  with  acceptable  read/ 
write  cycle  times  of  approximately  750  nanoseconds.  This  memory  would  be  packaged 
in  approximately  9-1/2  cubic  feet,  including  the  power  supplies.  The  current  cost  of 
such  a memory  system  at  approximately  0.5  per  bit  is  in  the  S100— 125k  category. 


TABLE  B2.  EFFECTS  OF  MULTIPLEX  RATIO  y 
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THE  NELC  MEMORY  SYSTEM 

The  memory  system  procured  for  scanner  testing  and  developmental  work  at 
NELC  need  not  be  large  enough  to  contain  an  entire  video  page.  Therefore,  a subset 
of  the  entire  frame  store  memory  was  selected  with  a multiplexed  ratio  rj  equal  to  8 
which  yields  a 65k-word  by  48-bit  memory.  This  memory  system  therefore  is  a one- 
eighth  slice  of  the  entire  frame  store  memory  and  can  store  a maximum  of  one-eighth 
of  a page  at  the  required  resolution.  Figure  B1  shows  how  this  memory  segment  can  be 
combined  with  seven  other  similar  units  to  perform  the  full  page  storage.  Line  A in  the 
figure  is  the  input  84  megapel  per  second  video  input.  It  is  4:1  demultiplexed  to  line  B, 
which  represents  four  21  megapel  per  second  lines.  Four  parallel  2:1  demultiplexers 
reduce  the  data  to  those  shown  in  line  C,  or  8 each  10.5  megapel  per  second  line.  The 
10.5  megapel  data  stream  in  line  C is  then  demultiplexed  further  by  a factor  of  8 to 
line  D,  which  is  the  1 .3  megaword  per  second  rate  compatible  with  the  memory  system. 
The  portion  of  the  entire  system  that  exists  at  NELC  is  the  shaded  area  with  an  input 
at  line  C from  the  image  scanner  test  bed  operating  at  a maximum  of  10.5  megapels 
per  second. 


MEMORY  SUPPORT  AND  CONTROL  HARDWARE 


The  memory  control  and  support  hardware  constructed  at  NELC  performs  three 
principal  functions:  input  digital  video  from  scanning  hardware  to  the  frame  store  memory, 
display  the  stored  image  on  a cathode  ray  tube  (raster  type  display),  and  process  or  ana- 
lyze the  digital  video  image  data  as  appropriate.  The  memory  controller  has  been  con- 
structed from  off-the-shelf,  state-of-the-art,  TTL  digital  hardware  and  based  on  the  Intel 
3000  series  LSI  computing  devices. 

The  hardware  is  composed  of  seven  major  functional  blocks  as  shown  in  figure  B2. 

In  operation  the  input  video  from  the  scanning  hardware  is  packed  or  demultiplexed  from 
6 to  48  bits.  The  48-bit  words,  each  containing  eight  6-bit  video  samples,  are  transferred 
to  the  memory  via  a data  bus  and  the  memory  I/O  logic.  The  same  memory  I/O  inter- 
face logic  is  used  to  extract  the  video  data  from  memory  and  present  them  to  the  output 
logic.  The  output  logic  contains  the  output  multiplexer,  which  takes  48-bit  words  and 
serializes  the  eight  6-bit  video  samples  into  the  same  digital  video  sequence  originally 
received.  The  output  logic  also  contains  hardware  with  the  ability  to  select  any  bit  pre- 
cision between  one  and  six,  or  any  bit  plane  between  one  and  six,  while  maintaining  the 
full  dynamic  range  of  the  D/A  converter  and  display.  The  system  contains  a manual  con- 
trol panel  which  can  display  the  contents  of  any  memory  word  or  input  a 48-bit  word  to 
any  memory  location.  In  addition,  any  one  of  10  internal  scratch  pad  registers  may  be 
displayed  or  modified  from  the  control  panel.  Other  manual  mode  and  control  functions 
are  also  provided.  A set  of  peripheral  input/output  ports  permits  communications  between 
the  memory,  the  control  system,  the  image  analyzer  system,  a magnetic  tape  unit,  a CRT 
display  terminal,  and  any  other  appropriate  peripheral  device  not  now  included.  The  upper 
left  hand  block  in  figure  B2  (the  processing  array)  is  composed  of  24  each  Intel  3002  cen- 
tral processing  elements. 


Figure  B2.  Simple  block  diagram. 
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These  devices  are  used  to  generate  and  maintain  memory  address  for  capture  and  display 
as  well  as  process  data  for  interface  to  the  peripheral  I/O  devices.  They  automatically, 
therefore,  provide  the  ability  to  process  video  data  from  the  memory.  Overall  system 
control  is  maintained  by  the  microprogram  control  unit  (one  Intel  3001)  and  its  associated 
micromemories.  All  bit-level  control  functions  performed  in  the  system  are  derived  from 
this  control  area.  Extensive  versatility  is  provided  in  the  microprogram  control  structure 
to  enable  both  macro  and  micro  level  (software  or  firmware)  control  of  the  entire  system. 
A detailed  description  of  the  operation  of  each  individual  subunit  within  the  memory 
control  system  follows. 


MEMORY  CONTROLLER  THEORY  OF  OPERATION 
SCANNER  INPUT  AND  PACKING  LOGIC 

The  scanner  input  interface  performs  two  functions.  First,  the  appropriate 
differential  line  driver/receiver  circuits  are  provided  for  direct  electrical  interface  to  the 
scanner  equipment.  In  figure  B3,  the  6 data  inputs,  representing  the  binary  coded 
equivalent  of  the  sampled  video,  are  presented  as  an  input  to  8 independent  6-bit  regis- 
ters. As  each  new  video  sample  arrives,  it  is  loaded  into  a new  6-bit  register  under  control 
of  a 3-bit  binary  counter  and  3-to-8  decoder,  all  driven  by  the  external  scanner  clock. 
When  all  eight  6-bit  registers  have  been  loaded,  the  next  clock  pulse  simultaneously  loads 
all  48  bits  into  the  second  register  and  relaods  the  first  6-bit  register.  In  this  manner  a 
continuous  6-to-48-bit  demultiplex  operation  is  performed  and  the  resulting  48-bit  words 
are  enabled  onto  the  Secondary  Data  Bus  (SDB)  for  entry  into  the  rest  of  the  system. 

Two  other  control  signals  received  by  the  scanner  input  interface  are  “Data  Available,” 
which  is  a frame  gate,  and  the  “Line  Sync”  signals.  These  signals  are  used  by  the 
microcontroi  structure  to  maintain  synchronization  between  the  scanner  and  the  memory 
address  generation.  Also,  the  microcode  sends  a “Capture”  command  to  the  scanner 
hardware  to  initiate  a frame  capture.  During  the  capture  of  a frame  from  the  scanner, 
the  entire  system  operation  is  controlled  by  and  timed  by  the  external  clock  coming 
from  the  scanner.  A timing  diagram  showing  the  relationship  between  the  various  control 
signals  and  the  external  clock  is  shown  in  figure  B4. 


MEMORY  INTERFACE 

The  memory  interface  logic  is  divided  into  four  basic  parts  (see  figure  B5): 
address  input  to  the  memory,  data  transmission  to  and  from  the  memory,  command 
lines  to  the  memory,  and  status  information  from  the  memory.  All  signals  associated 
with  the  memory  are  transmitted  over  differential  twisted-pair  lines.  High  common 
mode  rejection  and  a 15-volt  common  mode  range  of  the  twisted-pair  line  drivers,  re- 
ceivers, and  transceivers  (751 14/1 15/1 17)  provide  for  highly  reliable  data  transfers. 


ADDRESS 

The  address  information  is  generated  in  the  central  processing  arrays  and  pre- 
sented to  line  drivers  via  the  Memory  Address  Register  Bus  (MARB).  The  address 
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Figure  B3.  Scanner  input  & packing  logic. 
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Figure  B4.  Input  logic  timing 
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Figure  B5.  Memory  Interface. 
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information  is  actually  divided  into  two  parts.  One  is  a 16-bit  address  field  selecting  any  one 
of  the  available  65k  memory  words.  This  address  specifies  either  the  read  or  the  write  loca- 
tion in  memory.  In  addition  six  independent  byte  select  lines  are  provided  which  may 
selectively  enable  or  disable  the  write  operation  on  any  or  all  of  the  selected  8-bit  bytes. 

The  byte  select  inputs  are  not  active  for  read  operations. 


DATA  LINES 

The  48  data  bits  are  transmitted  to  and  from  the  memory  over  a common  48- 
pair  cable.  Forty-eight  twisted-pair  transceivers  operate  much  as  do  the  twisted-pair 
driver /receivers  used  for  the  memory  address  and  command  lines.  The  only  difference 
in  the  memory  data  lines  is  that  they  operate  in  half-duplex  mode;  that  is,  data  trans- 
mission occurs  in  both  directions  (to  or  from  the  memory)  over  the  same  lines  but  not 
at  the  same  time.  The  data  source  and  destination  in  the  control  system  is  a single 
48-bit  data  bus  called  the  Secondary  Data  Bus  (SDB). 


COMMANDS  TO  MEMORY 

There  are  five  control  signal  input  lines  associated  with  memory.  These  are  the  read, 
read  enable,  write,  and  refresh  request  commands  and  the  refresh  mode  control  line.  The 
memory  system  will  respond  to  input  commands  with  one  of  four  status  or  control 
replies  - data  available,  cycle  complete,  busy,  and  refresh  busy.  These  commands  and 
status  lines  are  used  in  various  ways  to  accomplish  one  of  the  three  possible  memory 
functions  (read,  write,  or  refresh). 


READ  OPERATION 

The  read  operation  is  performed  by  simply  transmitting  the  appropriate  memory 
address  to  the  memory  and  initiating  a read  command  pulse.  The  memory  system  will 
respond  with  a busy  signal  while  the  memory  itself  performs  the  function  and  waits  for 
required  propagation  delays.  After  the  minimum  access  delay,  the  data  from  memory 
will  be  available  on  the  48-bit  data  lines.  The  memory  will  then  respond  with  a data 
available  pulse,  at  which  time  the  memory  interface  tristate  buffers  may  be  enabled 
onto  the  SDB.  The  time  delay  or  propagation  delay  from  initiation  of  the  read  command 
until  the  memory  responds  with 'the  data  and  the  data  available  pulse  is  approximately 
450  nanoseconds.  The  memory  system,  however,  is  not  yet  ready  to  accept  another 
command.  The  busy  line  will  remain  true  for  another  200  nanoseconds  while  internal 
propagation  delays  in  the  memory  system  settle.  When  the  busy  signal  is  removed, 
the  cycle  complete  pulse  will  be  sent  by  the  memory  indicating  that  the  present  cycle 
has  been  completed.  It  is  convenient  that  the  memory  system  contains  its  own  48-bit 
data  register.  This  permits  the  memory  controller  to  return  at  a later  time  (provided  a 
subsequent  read  or  write  operation  has  not  been  performed)  and  simply  reenable  the 
memory  tristate  buffer  to  reread  the  same  data  word.  It  is  not  necessary  to  generate 
another  address  and  read  command. 
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WRITE  OPERATION 


In  the  write  operation  the  address  must  be  presented  to  the  memory  as  in  the  read 
operation.  The  write  operation  is  initiated  by  a write  pulse,  again  similar  to  the  read  oper- 
ation. The  one  important  difference  between  the  write  operation  and  the  previous  read 
operation  is  the  fact  that  the  six  byte  select  lines  must  be  appropriately  controlled.  A true 
on  a byte  select  line  will  permit  the  write  operation  to  occur  in  the  memory  in  the  selected 
8-bit  byte.  Any  or  all  of  the  six  8-bit  bytes  may  be  enabled  in  this  fashion  independently. 
The  response  of  the  memory  system  to  a write  operation  is  identical  to  that  of  a read 
operation. 


REFRESH 

t 

Since  the  memory  system  is  constructed  {"rom  dynamic  MOS  memory  chips,  the 
data  within  the  memory  are  volatile  and  must  be  refreshed  on  a periodic  basis.  According 
to  the  worst-case  specifications,  the  entire  memory  system  must  be  refreshed  every  milli- 
second. This  requires  that  64  refresh  request  signals  be  sent  to  the  memory  every  millisecond. 

The  specification  for  full  refresh  every  millisecond  is  determined  by  the  worst-case  conditions, 
particularly  at  elevated  temperatures.  In  a controlled  temperature  environment  this  speci- 
fication may  be  relaxed  considerably. 

The  memory  system  may  be  refreshed  in  two  different  ways.  If  desired,  the  refresh 
requirement  can  be  met  by  the  memory  system  itself  with  its  own  internal  logic.  With 
the  refresh  mode  signal  in  the  appropriate  state  the  memory  system  will  generate  refresh 
requests  on  a periodic  (but  asynchronous)  basis  and  satisfy  the  minimum  refresh  requirements. 

The  memory  system  during  automatic  refresh  will  automatically  disallow  any  read  or  write 
commands  attempted  during  the  refresh  cycle.  A busy  signal  called  refresh  busy  is  trans- 
mitted by  the  memory  system  during  refresh  operations  to  inform  the  control  hardware 
that  the  memory  is  not  available  due  to  refreshing.  The  timing  of  the  refresh  cycle  is 
approximately  the  same  as  that  of  a read  or  write  cycle. 

During  certain  types  of  operation  with  the  memory  (namely,  capture  and  display 
of  video  data)  it  is  not  permissible  to  allow  interruption  of  the  read  or  write  cycle  by 
automatic  refresh.  During  such  times  the  refresh  mode  control  is  switched  to  inhibit 

automatic  refresh.  The  refresh  requirement  must  then  be  met  by  the  control  unit  using  j 

the  refresh  request  signal.  The  refresh  request  signal  initiates  a refresh  cycle  exactly  as 

does  the  internal  automatic  refresh.  It  may,  however,  be  controlled  in  time,  or  synchronized 

to  other  operations  of  the  system.  In  actual  application  this  refresh  request  signal  is  sent 

to  the  memory  during  video  line  sync  times  where  it  will  not  interfere  with  the  storing  or 

displaying  of  video  data. 

Figure  B6  details  the  relative  timing  between  the  memory  command,  address,  data, 
and  status  reply. 


VIDEO  UNPACKING  AND  OUTPUT  LOGIC 


In  order  to  display  the  captured  image,  the  frame  store  memory  and  controller 
are  used  as  a refresh  memory  and  sync  generator  for  a raster-type  display  monitor.  Forty 
eight-bit  memory  words,  containing  eight  6-bit  video  samples,  represent  eight  pels  of  a 
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Figure  B6.  Memory  timing. 


video  line.  Address  generation  for  the  memory  read  cycles  is  performed  by  the  CPE 
arrays.  Since  the  captured  image  was  stored  on  a sequential  line-by-line  basis,  and  the 
TV  display  monitor  generates  an  interlaced  raster,  some  address  calculations  must  be 
performed  at  the  conclusion  of  each  video  line  to  achieve  interlace.  In  addition  to  display 
video  refreshing  the  CRT,  the  control  section  of  the  system  generates  independent  hori- 
zontal and  vertical  sync  pulses  for  the  monitor  timed  to  achieve  a 2-to-l  interlace. 
Standard  525  or  other  standard  line  sync  rates  are  not  required,  since  the  Conrac  RQA/B 
monitor  will  phase  lock  and  maintain  synchronization  over  a wide  range  of  input  hori- 
zontal and  vertical  frequencies.  The  system  has  the  ability  to  modify  these  rates  on  the 
fly  during  vertical  retrace  time  to  alter  the  display  parameters.  Additional  functions 
performed  by  the  video  output  logic  include  the  remultiplexing  of  eight  6-bit  video 
samples  into  a sequence  of  6-bit  video  pels  having  a frequency  eight  times  faster  than 
that  of  the  48-bit  memory  words.  Subsequent  logic  is  included  to  select  any  bit  pre- 
cision between  one  and  six  bits  or  any  bit  plane  between  one  and  six  for  presentation 
to  the  D/A  converter  and  the  monitor.  There  is  no  loss  in  analog  dynamic  range  during 
either  of  these  conversions. 

A GFE  9-bit-plus-sign  D/A  converter  capable  of  operating  in  excess  of  100  MHz 
is  used  to  generate  the  analog  video  for  the  display.  Although  this  converter  represents 
a considerable  overkill  in  speed  for  the  system,  it  was  available  to  the  program  at  no 
cost.  A variety  of  commercial  6-or-more-bit  D/A  converters  is  available  to  perform 
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this  function.  Simple  operational  amplifier  level  shifters  are  provided  to  convert  the 
digital  sync  signals  to  those  which  are  recognizable  by  the  monitor.  Figure  B7  is  a block 
diagram  of  the  video  output  and  unpacking  logic  and  the  analog  interface  to  the  display. 


, VIDEO  OUTPUT  MULTIPLEXER 

The  output  video  multiplexing  is  performed  by  reading  a 48-bit  word  from  memory 
and  storing  it  in  a 48-bit  output  register  via  the  data  bus.  A 3-bit  binary  counter  and 
3-to-8  decoder  is  then  used  to  selectively  enable  6-bit-wide  tristate  buffers  onto  a 6-bit 
video  data  bus.  The  same  clock  used  to  increment  the  binary  counter  is  used  to  clock 
each  successive  6-bit  video  sample  to  a 6-bit  retiming  register  in  a manner  such  that  as 
each  new  video  sample  is  enabled  onto  the  bus  the  previous  sample  is  stored  for  further 
processing. 

BIT  PLANE/BIT  PRECISION  LOGIC 

The  bit  plane/bit  precision  logic  must  select  either  one  of  the  six  bit  planes,  or 
any  one  of  the  six  possible  bit  precisions,  to  be  transmitted  to  the  D/A  converter.  It  is 
important  that  no  loss  of  analog  dynamic  range  occur  during  the  process.  This  is  ac- 
complished by  either  selecting  the  desired  bit  plane  or  (exclusive  or)  selecting  a desired 
bit  precision.  The  6-bit-wide  digital  video  is  presented  simultaneously  to  an  8-to-l 
multiplexer  for  bit  plane  select  and  to  the  second  stage  of  logic  which  may  or  may  not 
be  used  to  select  the  desired  bit  precision.  The  logic  circuitry  implementing  this  function 
operates  in  the  following  fashion  (see  fig  B7).  The  bit  plane  selector  is  a simple  8-to-l 
multiplexer  while  the  bit  precision  selector  is  a hex  2-to-l  multiplexer  set  with  additional 
copy  logic  used  to  maintain  full  analog  dynamic  range.  In  operation,  the  decision  sequence 
involves  first  selecting  a bit  plane  between  one  and  six  or  no  bit  plane.  If  a particular 
bit  plane  is  selected,  the  bit  precision  2-to-l  multiplexers  are  switched  to  the  bit  plane 
multiplexer  output.  The  bit  plane  control  lines  select  one  of  the  six  bit  planes  and  con- 
nect it  to  the  A inputs  of  all  six  bit  precision  multiplexers.  If  bit  plane  0,  which  is 
nonexistent,  is  selected,  then  the  6-bit  digital  video  is  selected  and  the  B input  to  the 
bit  precision  multiplexers  is  enabled. 

Copying  logic  (not  detailed  in  fig  B7  for  simplicity)  in  the  bit  precision  selectors 
is  what  maintains  the  full  analog  dynamic  range  in  the  D/A  output.  Consider  a bit  pre- 
cision selection  of  five  as  an  example.  The  high-order  five  video  bits  are  connected 
through  line  driver/receiver  circuits  to  the  high-order  five  bits  of  the  D/A  converter.  The 
low-order  bit  of  the  D/A  converter  is  connected  to  the  most  significant  video  bit,  thereby 
duplicating  the  most  significant  bit  in  the  least  significant  bit  position.  This  connection 
assures  that  a video  sample  of  value  OOg  will  be  transmitted  to  the  D/A  converter  as  a 
full  6-bit-wide  0 word  and  the  maximum  value,  77g,  will  also  be  connected  to  the  D/A 
converter  as  a 77g.  Subsequent  lower  bit  precision  selections  are  implemented  in  a 
similar  fashion  in  which  the  highest  selected  video  bits  are  connected  straight  through  and 
the  unused  low-order  positions  are  copies  of  the  high-order  positions.  Any  connection 
other  than  this  scheme  either  sacrifices  D/A  dynamic  range  or  produces  non  linear  steps 
in  the  video  output. 
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Figure  B7.  Video  output  & unpacking  logic. 


Since  the  D/A  converter  (which  is  located  adjacent  to  the  display)  contains  its 
own  retiming  register,  the  same  clock  used  for  the  video  multiplexer  is  transmitted  to 
the  D/A  converter.  Additional  timing  signals  are  the  horizontal  and  vertical  sync  pulses 
for  the  display.  Either  the  program-generated  syncs  are  sent  to  the  display,  or  in  their 
absence,  automatic  sync  signals  are  substituted  in  order  to  maintain  the  monitor  phase 
locked  loops  in  their  normal  operating  range. 


PROCESSING  CIRCUITRY 

The  memory  controller  (as  described  above)  generates  command  functions  for 
the  memory  and  monitors  status  replies  in  order  to  perform  the  required  data  transfers. 
Since  the  capture  operation  is  a line-by-line,  noninterlaced  function  and  the  display 
monitor  requires  a TV  type  2-to-l  interlaced  video  input,  some  form  of  address  calcu- 
lations is  required.  For  example,  if  the  incoming  video  data  are  stored  sequentially 
during  the  capture  operation,  then  for  display  of  that  image,  every  other  video  line  must 
be  presented  to  the  display  for  field  one  and  the  second  set  of  alternating  lines  must  be 
displayed  on  field  two.  This  means  that  the  controller  must  sequentially  output  the 
video  on  line  one  of  field  one,  then  add  a constant  (equal  to  the  number  of  words/line) 
in  order  to  skip  the  next  line,  and  output  the  second  line  of  the  same  field.  In  addition 
to  address  calculation,  direct  arithmetic  or  logical  manipulation  of  the  video  image  is 
necessary.  The  processing  circuitry  comprises  a standard  Arithmetic  Logic  Register  Unit 
(ALRU). 

The  hardware  selected  to  implement  the  ALRU  is  the  Intel  3002  Central  Processing 
Element.  The  3002  chip  is  an  Schottky  bipolar  large-scale-integrated  circuit  containing  a 
2-bit  slice  of  a complete  ALRU.  It  is  expandable  by  use  of  additional  chips,  and  optionally 
lookahead  carry,  to  any  desired  word  width  in  2-bit  increments.  The  unit  contains  an 
arithmetic  logic  unit  recognizing  39  simple  microcommands.  A total  of  1 3 registers  is 
provided  including  an  accumulator  and  memory  address  register  (with  outputs  accessible) 
and  1 1 scratch  pad  registers. 

The  complete  memory  controller  utilizes  24  of  the  3002  chips  to  assemble  a 
complete  48-bit  processing  section  plus  three  additional  (Intel  3003)  fast  lookahead  carry 
chips.  The  48-bit-wide  ALRU  provides  all  the  flexibility  necessary  for  address  generation, 
memory  control,  and  video  processing  that  is  now  required  or  might  be  required  in  the 
future.  A detailed  description  of  the  operation  of  the  3002  devices  is  available  from 
Intel  corporation  publications.  The  Intel  series  3000  reference  manual  (98-221  A)  con- 
tains data  sheets  covering  the  3002  central  processing  element  and  all  the  other  3000 
series  compatible  devices.  Figure  B8  shows  the  3002  block  diagram  and  summarizes 
the  microfunctions  it  implements. 


MANUAL  CONTROL  PANEL 

In  order  to  operate  the  system,  a manual  data  display  and  function  control  panel 
is  provided.  It  is  possible,  from  the  control  panel,  to  load  48-bit  words  into  the  accumu- 
lator or  any  R register,  display  the  contents  of  the  accumulator  or  any  R register,  and 
control  the  clock  and  mode  functions.  Figure  B9  shows  the  layout  of  the  various  switches 
and  displays  available. 
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Figure  B8.  3002  block  diagram  and  instructions 
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Figure  B9.  Manual  control  panel. 


DATA  IN/DISPLAY 

Sixteen  octal  coded  lever  switches  are  provided  to  enter  48-bit  data  words  into 
the  system.  Solid-state  buttons  and  an  additional  decade  lever  switch  permit  data 
entry  to  any  R register  or  the  accumulator.  These  registers  may  be  examined  on  16 
octal  coded  displays  located  directly  below  the  lever  switches.  Operation  of  the  manual 
data  transfers  is  as  follows. 

A register  is  selected  by  touching  the  accumulator  button  or  the  Rn  button  with 
Rq  - R9  selected  on  the  Rn  switch.  Each  time  the  accumulator  or  Rn  button  is  touched, 
the  display  presents  the  contents  of  the  selected  register.  Data  entry  is  accomplished  by 
setting  the  desired  register,  and  touching  the  set  button.  The  data  on  the  lever  switches 
will  be  transferred  to  the  selected  register  and  the  contents  of  that  register  will  be  displayed. 
A clear  button  is  also  provided.  Operation  is  like  that  of  the  set  button  except  that 
the  lever  switches  are  ignored  and  all  zeros  are  loaded  into  the  selected  register  and 
displayed. 


A deposit  button  is  provided  to  enable  the  manual  entry  of  48-bit  words  into 
any  selected  main  memory  location.  This  is  accomplished  by  the  following  procedure: 
first,  register  R7  is  selected  and  the  desired  memory  location  is  set  into  the  low-order 
16  bits.  The  desired  data  word  to  be  loaded  into  memory  is  then  set  on  the  lever 
switches  and  the  deposit  button  is  touched.  This  operation  inputs  data  from  the  lever 
switches  to  the  memory  location  specified  by  R7  and  subsequently  displays  the  contents 
of  the  memory  location  (R7  + 1).  Further  details  on  the  examine  and  deposit  functions 
are  included  in  the  microprogramming  section. 

CLOCK  CONTROL 

Three  switches  are  provided  in  the  upper  left  corner  of  the  front  panel  which 
permit  manual  selection  of  the  system  clock  source.  During  capture  of  video  data 
from  the  scanning  hardware  the  external  clock  position  must  be  selected.  In  this 
mode  of  operation  the  entire  system  is  clocked  and  timed  by  use  of  the  clock  trans- 
mitted from  the  scanning  hardware.  This  synchronizes  the  two  systems  and  avoids 
further  retiming  hardware.  The  other  two  clock  source  buttons  select  internal  clocks 
of  two  speeds.  The  HS  (high  speed)  clock  is  the  clock  used  for  display  of  video  data  or 

(execution  of  other  programs  at  video  rates.  The  MOS  clock  is  a counted-down  version 
of  the  HS  clock  and  is  used  for  lower-speed  functions.  Clock  source  selection  may  also 
be  performed  under  program  control.  Further  details  are  included  in  the  microprogram- 
ming section. 
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MODE  CONTROL 

In  the  lower  right  hand  portion  of  the  control  panel  the  mode  control  buttons 
are  located.  These  switches  are  used  to  command  the  system  to  execute  commands  in 
various  ways.  Instructions  can  be  run,  stepped,  or  repeated  by  use  of  the  mode  control 
buttons,  and  a master  system  reset  button  is  also  included.  A complete  description  of 
the  operation  of  these  controls  must,  however,  be  delayed  until  after  the  sections  on 
macro  and  micro  programming. 


FAULT  LIGHT 

There  are  certain  error  conditions  detectable  by  the  microprogram  in  the  machine 
where  a convenient  fault  point  is  available.  If  these  conditions  occur,  the  machine  sus- 
pends all  operation  and  turns  on  a fault  light.  The  contents  of  registers  and  memory 
locations  may  be  examined  and  the  system  may  resume  operation  after  a system  reset. 

BOOTSTRAP 

The  last  special  function  of  the  control  panel  is  provided  by  the  bootstrap  button. 
This  button  is  only  used  to  initialize  the  system.  Its  function  is  to  initiate  a special 
microprogram  which  loads  the  main  memory  with  all  constants  and  monitor  instructions 
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necessary  for  further  operation  using  the  terminal.  The  data  source  necessary  to  implement 
this  automatic  load  function  is  a magnetic  tape  unit  and  therefore  no  manual  setup  operations 
are  required.  The  power-up  procedure  is  simple:  load  the  appropriate  magnetic  tape,  apply 
power  to  the  system,  and  touch  the  bootstrap  button.  All  system  operation  may  then  be 
performed  from  the  Tektronix  CRT  terminal. 


PERIPHERAL  INTERFACE 

In  order  for  the  memory  and  control  system  to  communicate  command  and 
data  information  to  peripheral  devices,  interface  hardware  is  provided.  There  are 
three  groups  of  interface  hardware  (not  including  the  scanning  hardware  or  the  memory), 
each  with  multichannel  capability.  The  peripheral  devices  currently  connected  to  the 
interface  hardware  are  the  tektronix  4023  CRT  display  terminal,  the  image  analyzer 
hardware,  and  magnetic  tape  equipment. 


IMAGE  ANALYZER  INTERFACE 

The  image  analyzer,  constructed  to  generate  image  statistics  at  video  rates,  is 
connected  to  the  memory  controller  via  an  8-bit  parallel  data  channel.  The  interface 
allows  the  memory  controller  to  send  commands  to  the  analyzer  hardware  for  control 
purposes.  It  is  also  possible  to  transmit  digital  video  to  the  analyzer,  from  either  main 
memory  or  magnetic  tape,  for  image  statistics  generation.  Subsequently,  the  result  of 
the  selected  analysis  can  be  transferred  back  to  the  memory  controller  for  further  pro- 
cessing or  data  reduction.  Besides  the  8-bit  data  field,  the  interface  includes  a 2-bit 
function  control  field  and  a 2-bit  address  field.  It  is  therefore  possible  to  connect  three 
additional  hardware  peripheral  devices  to  this  interface  channel  by  using  the  2-bit  ad- 
dress field  as  a device  select  field. 


TERMINAL  INTERFACE 

The  GFE  Tektronix  4023  CRT  display  terminal  is  included  in  the  system  for 
control  purposes  as  well  as  display  of  program  and  statistical  information.  The  inter- 
face to  the  terminal  is  similar  to  the  image  analyzer  hardware  in  that  data  are  transferred 
as  8-bit  characters.  The  characters  are  transferred  bit  serial,  however,  by  use  of  a 9600- 
baud  RS-232C  interface.  The  memory  controller  includes  the  serial-to-parallel,  parallel- 
to-serial,  and  timing  logic  required  for  the  bit  serial  interface.  Subsequently  to  the 
parallel/serial/parallel  conversions  and  retiming  necessary,  the  interface  operates  in  an 
8-bit  parallel  fashion.  It  is  therefore  possible  to  use  the  terminal  to  display  decimal 
image  statistics  and  alphanumeric  information  in  a columnar  format.  A compatible 
Tektronix  hard-copy  unit  is  also  available  to  facilitate  the  generation  of  hard-copy  per- 
manent records.  The  terminal  interface,  like  the  analyzer  interface,  also  includes  a 2-bit 
device  select  field.  This  permits  the  interface  to  communicate  with  three  additional 
RS-232C  type  devices. 
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MAGNETIC  TAPE  INTERFACE 


Since  the  main  memory  in  the  system  is  dynamic  MOS  volatile  memory,  all 
information  contained  in  the  memory  is  lost  during  power  failure  or  normal  power 
shutdown.  Since  large  amounts  of  command  and  program  information  may  be  con- 
tained in  the  memory,  it  is  necessary  to  provide  some  form  of  nonvolatile  magnetic 
storage.  This  storage  can  in  addition  be  used  to  store  complete  video  frames  of  informa- 
tion at  the  required  Postal  Service  resolution.  Images  so  stored  can  be  retrieved  at 
subsequent  times,  reprocessed,  or  otherwise  manipulated  without  the  necessity  of  a new 
capture. 

Since  the  magnetic  tape  data  transfers  require  a control  register  wider  than  the 
8 bits  of  the  other  interfaces,  and  require  block  transfers  of  data,  the  interfaces  are 
considerably  different  from  those  described  above.  Two  magnetic  tape  interface  channels 
are  provided,  each  channel  having  the  capability  of  communicating  with  four  tape 
drivers.  Special  microroutines  are  provided  for  each  tape  channel  to  facilitate  differences 
between  the  tape  units  available,  and  to  facilitate  the  block  transfers  of  data  required. 
Also  included  are  standard  command  register  outputs  and  sense  or  status  condition 
inputs  from  the  magnetic  tape  unit  to  the  control  system. 

These  interface  channels  (relatively  few  in  number)  provide  all  the  flexibility 
needed  to  perform  the  capture,  storage,  display,  processing,  and  analysis  of  Postal  Video 
images. 


MICROPROGRAM  CONTROL 

A crucial  part  of  any  digital  logic  system  is  the  control  sequence  generator.  This 
logic  block  is  responsible  for  maintaining  system  timing  and  synchronization.  It  generates 
all  the  necessary  control  signals  required  by  the  remainder  of  the  system.  This  control 
sequencer  is  responsible  for  directing  the  operation  of  all  other  logic  blocks  within  the 
system.  Methods  of  implementing  this  control  hardware  fall  into  two  general  categories. 
Older  equipment  generally  used  a sequential  state  counter  approach  in  which  the  entire 
control  structure  is  defined  by  hardwired  logic  elements.  This  is  perfectly  adequate  for 
smaller  logic  systems  or  for  those  in  which  changes  in  the  control  structure  will  not  be 
made.  Extensive  hardware  rework  may  be  required  in  this  type  of  control  structure  if 
minor  alterations  in  the  sequence  generator  output  states  are  required.  A more  versatile 
approach  in  which  the  control  structure  is  stored  as  in  a bit  pattern  in  a memory  is 
called  microprogramming.  All  that  is  required  to  completely  alter  the  control  structure 
of  the  machine  in  a microprogrammed  control  unit  is  to  reprogram  the  micromemory. 

The  state  of  all  control  signals  required  internally  to  the  machine  is  stored  in  the  micro- 
memory either  in  direct  or  encoded  form.  A micromemory  address  generator  of  some 
type  is  used  to  select  the  microcontrol  words  one  at  a time. 

In  the  NELC  memory  controller  hardware  the  microprogram  address  generator 
is  an  Intel  3001  microprogram  control  unit.  Two  separate  microprogram  memories  are 
provided  for  control  storage.  One  memory  is  the  high-speed  programmable  read  only 
memory  (PROM)  which  stores  the  controls  required  to  manipulate  data  at  video  rates. 

This  memory  is  supplemented  by  a smaller  electrically  alterable  read  only  memory 
(EAROM)  which  is  used  at  slower  speeds  for  microprogram  development,  testing,  and 
operation  at  low  speeds. 
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3001  MICROPROGRAM  CONTROL  UNIT 


The  Intel  3001  microprogram  control  unit  contains  the  micromemory  address 
register  and  all  the  logic  necessary  to  maintain  proper  micromemory  sequencing.  (Refer 
to  the  block  diagram  of  fig  10).  The  microprogram  address  register  is  a 9-bit  register 
with  outputs  designated  MAq  through  MAg.  The  content  of  this  address  register  selects 
any  one  of  the  possible  512  micromemory  locations.  The  register  contents  are  syn- 
chronously determined  by  the  next  address  logic  one  of  several  ways.  The  low-order  8 
bits  of  the  register  can  be  loaded  from  the  primary  and  secondary  instruction  bus  inputs 
by  taking  the  LD  input  high.  After  the  rising  edge  of  the  clock,  the  data  on  the  secondary 
instruction  bus  will  be  loaded  into  MA4  through  MA7  and  the  data  on  the  primary 
instruction  bus  will  be  loaded  into  MAq  through  MA3.  For  the  load  operation  MAg 
is  always  set  to  a logic  0.  During  normal  microprogram  execution,  the  next-address 
logic  generates  each  successive  microprogram  address  as  a function  of  the  current  address 
and  the  address  control  function  inputs  (ACq  through  ACg).  The  C and  Z flag  and  the 
F latch  may  also  affect  the  next  microprogram  address,  depending  on  the  contents  of 
the  ACq  through  AC6  inputs.  For  a detailed  description  of  this  complicated  operation 
refer  to  the  published  Intel  3001  data  sheet. 

Figure  B1 1 shows  how  the  3001  and  the  microprogram  address  and  all  other 
microlevel  system  control  functions.  In  operation,  each  micromemory  output  word 
contains  the  appropriate  system  controls.  Also,  information  is  fed  back  to  the  address 
control  function  input  to  enable  the  next-address  logic  to  generate  the  next  microprogram 
address.  Each  sequency  of  microinstructions  causes  the  system  to  perform  some  desired 
function.  The  micro  starting  address  for  a particular  sequence  is  first  loaded  into  the 
microprogram  address  register.  The  sequence  is  then  executed  until  completion,  at 
which  time  the  starting  address  for  the  next  sequence  is  fetched.  The  data  source  for 
this  load  function  may  be  alternately  the  high-order  bits  from  a main  memory  word  or 
from  the  front  panel  lever  switches.  By  using  main  memory  as  the  starting  address  source, 
a long  sequence  of  microroutines  may  be  generated.  This  provides  for  macrolevel 
control  of  the  microprogram  memory.  There  are  currently  implemented  in  the  micro- 
program memory  two  classes  of  instructions.  One  group  contains  the  microcode  to 
enable  the  capture  or  display  of  the  video  data.  The  second  group  is  a primitive  instruction 
set  allowing  arithmetic  and  logic  functions  to  be  performed  under  macroprogram  control. 

SPEED  CONSIDERATIONS 

As  described  earlier,  the  3001  micro  control  unit  generates  the  micromemory 
address  information  for  the  microinstruction  memory.  Speed  considerations  have  made 
it  necessary  to  separate  the  microinstruction  memory  into  two  separate  memories. 
Micromemory  one  is  a low-speed  UV  erasable  MOS  EAROM.  Since  this  micromemory 
can  be  erased  and  reprogrammed  repeatedly,  it  is  used  for  program  development  and 
testing.  Its  1 -microsecond  cycle  time  requirement,  however,  is  far  too  long  to  be  useful 
for  video  routines.  Micromemory  two  is  a Schottky  TTL  PROM  which  unfortunately 
is  not  erasable.  After  video  and  other  microroutines  are  tested  and  debugged  in  the 
MOS  memory,  they  are  permanently  programmed  into  micromemory  two  where  they 
operate  at  the  video  rates. 


B-22 


Figure  B 1 1 . Microcontrol  block  diagram. 
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The  3001  microcontrol  unit  applies  its  address  output  to  both  micromemories 
simultaneously  (refer  to  fig  B12).  At  each  system  clock  pulse  the  MCU  generates  the 
next  microaddress,  and  the  previous  microinstruction  is  loaded  into  independent  pipe- 
line registers  from  each  micromemory.  The  microinstructions  stored  in  the  pipeline 
registers  are  tristate  buffered  to  a single  microinstruction  bus,  the  selection  controlled 
by  the  system  clock  source.  When  the  low-speed  MOS  clock  is  selected,  the  same  signal 
enables  instructions  from  the  MOS  memory  onto  the  microinstruction  bus.  When  high- 
speed operation  is  required,  the  high-speed  (HS)  or  the  external  (EXT)  clock  is  selected 
and  micromemory  two  is  enabled.  The  appropriate  clock  source  flip-flop,  and  therefore 
micromemory  selection,  may  be  made  either  manually  from  the  front  panel  or  via  system 
control  lines  under  program  control. 

MICROCODE  AND  MICROPROGRAMMING 

The  microcode  implemented  in  the  memory  controller  uses  a 48-bit  microcontrol 
word  divided  into  14  control  fields.  The  fact  that  the  control  word  is  48  bits  long  is 
coincidental  and  has  no  direct  relationship  to  the  48-bit  main  memory  width.  Table  B3 
indicates  the  width  of  each  control  field  and  its  use. 


TABLE  B3.  CONTROL  WORD  FIELDS 


Control 

Word 

Field 

Bits 

Width 

Function 

06-00 

7 

3001  next-address  control 

10-07 

4 

3001  flag  control 

17-11 

7 

3002  function  code 

19-18 

2 

K logic  control 

22-20 

3 

Bus  data  source  control 

25-23 

3 

Bus  data  source  control 

27-26 

2 

Main  memory  command 

29-28 

2 

Clock  source  control 

30 

1 

3002  clock  inhibit 

34-31 

4 

External  function  A 

38-35 

4 

External  function  B 

40-39 

2 

Address  bus  data  source 

45-41 

5 

Test  input  select 

46 

1 

False  test 

47 

1 

Spare 

The  control  fields  are  decoded  when  appropriate  and  the  resulting  signals  control 
the  logic  in  the  rest  of  the  system.  Strings  or  sequences  of  microcontrol  words  imple- 
ment the  more  general  macrolevel  instructions.  Using  a program  counter  (R9)  and  a 
microroutine  (Fetch)  to  read  instructions  from  main  memory,  full  programmability  is 
achieved. 
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Figure  B12.  Mierocontrol  and  micromemory  select  block  diagram. 


A detailed  description  of  the  microcode  and  the  instruction  set  is  omitted  because 
of  its  extreme  complexity;  however,  some  of  the  information  is  presented  in  appendix  A. 

A complete  description  of  the  microinstruction  field  decode  is  included.  Also  included  in 
appendix  A is  a summary  of  all  macroinstructions  implemented  in  the  microcode  as  well 
as  a detailed  description  of  the  operation  of  each  instruction.  The  last  part  of  appendix  A 
contains  some  sample  flow  charts  of  microcode  implementing  the  fetch  and  front  panel 
operations  and  the  video  capture  and  display  operations.  The  flow  charts  provide  a de- 
tailed map  of  the  microcode  execution. 

An  example  of  a typical  operation  would  start  at  instruction  0Fpj  (upper  left  cor- 
ner of  appendix  A,  page  BA- 12  and  proceed  down  the  left  side  of  the  page  through  the 
fetch  routine.  This  sequence  of  microinstructions  uses  scratch  pad  register  R9  as  a pro- 
gram counter  and  fetches  from  main  memory  an  instruction  from  the  location  specified 
by  R9.  If  the  instruction  selected  happened  to  be  an  “Examine”  instruction  (Op  Code 
0 6h),  then  the  microcode  would  jump  from  the  lower  left  hand  instruction  to  the 
upper  right  hand  corner  of  the  flow  chart  (appendix  A)  and  proceed  through  the  examine 
routine.  The  last  microinstruction  of  all  macroroutines  must  necessarily  be  a jump  back 
to  the  beginning  of  the  fetch  routine  located  at  In  this  manner  a continuous 

fetch/execute  sequence  is  implemented. 

An  appreciation  of  the  complexity  involved  in  the  video  operations  can  be  gained 
by  observing  the  flow  charts  of  the  capture  and  front  panel  control  microroutines.  It  should 
be  noted,  however,  that  with  a current  total  of  768  microinstruction  locations  available 
in  the  two  read  only  memories,  only  approximately  one-half  have  been  used  to  imple- 
ment all  the  currently  available  functions. 

One  memory  is  a high-speed  programmable  read  only  memory  (PROM)  which 
stores  the  controls  required  to  manipulate  data  at  video  rates.  This  memory  is  supple- 
> mented  by  a smaller  electrically  alterable  read  only  memory  (EAROM)  which  is  used  at 

slower  speeds  for  microprogram  development,  testing,  and  operation  at  low  speeds. 

MODE  CONTROL  BUTTONS 

In  order  to  provide  for  manual  control  of  program  execution,  four  mode  control 
buttons  are  provided  on  the  front  panel.  Two  step  controls,  a repeat  function,  and  a 
run  button  provide  an  operator  with  versatile  control  of  program  execution.  Testing 
and  debugging  can  be  done  at  the  macrolevel  or  microlevel.  In  the  instruction  hierarchy, 
macroinstructions  fetched  from  memory  by  use  of  the  program  counter  (R9)  are  im- 
plemented by  sequences  of  microinstructions.  In  normal  operation  the  contents  of  R9 
are  used  as  an  address  by  a microroutine  (fetch)  for  a memory  read  operation.  The 
data  fetched  from  memory  become  the  macroinstruction  to  be  executed.  The  high-order 
bits  of  the  data  from  memory  (the  OP  Code)  are  loaded  into  the  micromemory  address 
sequencer  at  the  end  of  the  fetch  operation.  The  macroinstruction  is  then  executed 
in  the  microcode  with  the  last  microinstruction  returning  to  the  fetch  sequence.  The 
program  counter  (R9)  is  incremented  in  order  to  fetch  the  next  instruction  or  loaded 
for  jump,  branch,  or  skip  instruction. 
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The  two  step  buttons  are  used  for  program  testing  and  debugging  at  either 
the  macrolevel  or  the  microlevel.  If  step  micro  is  selected,  each  push  of  the  step  micro 
switch  will  permit  one  system  clock  pulse  to  increment  the  microinstruction  address 
one  step.  In  this  way  the  microroutines  may  be  executed  on  a one-step-at-a-time  basis. 
The  step  macro  button  enables  one  complete  fetch/execute  cycle.  Therefore,  typical 
machine  language  programs  may  be  executed  one  step  at  a time  for  program  debugging 
purposes.  The  repeat  button  is  used  in  conjunction  with  either  step  button  or  the  run 
button  as  a further  aid  to  microlevel  or  macrolevel  testing.  If  step  micro  and  repeat  are 
selected  simultaneously,  the  clock  pulse  to  the  3001  microcontrol  unit  will  be  inhibited. 
Each  time  the  step  micro  button  is  touched,  therefore,  the  same  microinstruction  will 
be  executed.  The  entire  system  would  perform  normally,  with  the  exception  of  the 
3001  microcontrol  unit.  Similarly,  if  repeat  and  step  macro  are  selected,  the  increment 
of  program  counter  (R9)  will  be  inhibited.  The  same  microroutme  will  be  fetched  and 
executed  each  time  the  step  macro  button  is  touched.  Since  these  step  functions  occur 
on  a single-shot  basis,  they  are  not  observable  by  test  equipment  requiring  repetitive 
wave  forms.  The  run  button  may  be  used  in  conjunction  with  the  step  repeat  functions 
in  the  following  manner.  If  either  step  repeat  function  has  been  selected  and  the  run 
button  is  touched,  the  system  will  repetitively  execute  a single  microinstruction  or  the 
same  fetch/execute  sequence.  This  permits  a single  microinstruction  or  a single  micro- 
routine to  be  repeated  continuously.  Test  equipment  such  as  oscilloscopes,  waveform 
monitors,  counters,  and  logic  analyzers  may  then  be  used  to  verify  proper  system 
operation  at  the  signal  level. 


RESULTS 

Before  the  peripheral  devices  (magnetic  tape  unit,  image  analyzer  display  terminal) 
became  available,  preliminary  testing  demonstrated  the  systems  ability  to  capture  and 
display  video  images  using  a Fairchild  CCD1 10  line  scanner.  A 1970  IEEE  facsimile 
test  chart  was  used  as  the  test  image  during  preliminary  tests.  The  Fairchild  CCD1 10 
scanner  contains  only  256  pels;  however,  it  can  operate  at  relatively  high  speeds  (100 
nanoseconds  per  pel).  Due  to  the  256-pel-per-line  limit  of  the  scanner,  only  a narrow 
stripe  of  the  facsimile  test  chart  could  be  scanned  at  a resolution  of  200  pels  per  inch. 
Nevertheless,  images  were  captured  and  displayed,  and  some  preliminary  analysis  was 
accomplished  with  this  setup.  It  has  been  shown  with  a high  degree  of  confidence  in 
early  testing  that  images  can  be  captured,  stored,  and  processed  at  speeds  consistent  with 
the  Postal  Service’s  20  pages  per  second  goal.  This,  of  course,  is  contingent  on  the 
verification  that  scanners  can  supply  the  required  video. 

In  addition  to  simple  capture  and  display  of  video  images,  early  results  include 
the  writing,  debugging,  and  operation  of  three  simple  processing  programs.  Using  these 
programs  it  is  possible  to  calculate  the  intensity  statistics  for  a display  image,  to  generate 
a histogram  presentation  of  the  results  of  the  statistics  generated,  and  to  “Webervert” 
the  displayed  image  from  6-bit  video  to  5-bit  video.  Verification  that  the  operation  of 
the  system  is  as  intended  may  be  gained  through  the  use  of  test  and  calibration  programs. 
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IMAGE  STATISTICS  GENERATION 

The  image  intensity  statistics  generator  program  uses  an  iterative  approach  to 
count  the  number  of  times  each  particular  video  intensity  level  exists  in  the  display 
image.  The  output  from  the  program  is  a set  of  64  numbers  representing  the  number 
of  times  each  video  level  exists  in  a display. 


HISTOGRAM  GENERATOR 

In  order  to  present  a graphic  display  of  the  results  of  the  image  statistics  generation, 
a bar  graph  type  display  was  created  using  the  64  intensity  statistics.  In  the  bar  graph 
display  the  64  possible  intensity  levels  are  represented  b>  64  horizontal  bars.  The  bottom 
bar  in  the  display  represents  black  (or  video  level  zero)  and  the  top  bar  on  the  display 
represents  white  (video  value  63).  The  length  of  the  bar  represents  the  number  of 
times  a particular  video  pel  is  found  to  exist  in  the  displayed  image.  A totally  black 
picture  would  generate  a bar  graph  which  would  be  a single  bar  on  the  bottom  of  the 
display  the  full  length  of  the  display  and  no  bars  for  video  levels  1 through  63. 

Prior  to  generation  of  the  bar  graph  itself,  the  statisitics  data  are  normalized  and 
scaled.  The  scale  factor  for  a particular  bar  graph  display  is  represented  by  a number 
of  small  black  dots  in  the  lower  left  hand  corner  of  the  bar  graph.  If  there  are  no  dots 
present  in  the  display,  the  full  scale  value  for  a bar  would  be  100%.  Each  scale  factor 
mark  indicates  that  the  full  scale  value  of  a bar  graph  has  been  divided  by  two;  thus, 

, one  scale  mark  indicates  50%  full  scale,  two  marks  indicate  25%  full  scale,  etc.  The 

maximum  number  of  scale  factor  marks  would  be  five,  indicating  a full  scale  value  of 
3.125%. 

Although  the  original  testing  used  the  histogram  generator  to  display  image 
intensity  statistics,  the  program  is  general  purpose  and  could  be  used  to  present  any 
arbitrary  group  of  64  numbers  as  a bar  graph 


CALIBRATION 

In  order  to  verify  that  the  statistics  generator  and  histogram  generator  programs 
are  operating  correctly,  a test  input  program  is  available  for  calibration  purposes.  This 
simple  program  generates  a display  of  a 64-level  gray  scale  wedge.  See  figure  B13.* 

This  display  contains  an  equal  number  of  all  64  possible  gray  scales.  When  this  image 
is  used  as  an  input  to  the  statistics  generator,  the  number  of  pels  in  each  gray  scale 
should  be  equal  to  the  total  number  of  pels  in  the  display  divided  by  64.  The  histogram 
resulting  from  such  a display  is  shown  in  figure  B13  (64  bars  of  equal  length).  When 
this  set  of  test  programs  is  operated  (with  the  results  indicated  in  fig  B 1 3),  the  system 
is  verified  as  operating  correctly. 


•The  error  in  scale  factor  marks  on  the  histogram  display  of  figure  B13  was  due  to  incorrect  settings 
on  the  display  controls,  not  program  error. 
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TEST  IMAGE 

After  the  calibration  routine  indicates  correct  system  operation,  test  images  can 
be  scanned  and  analyzed.  Figure  B 14  is  an  image  of  a portion  of  the  IEEE  facsimile 
test  chart  and  its  associated  histogram.  As  expected,  this  black  and  white  image  produces 
a histogram  with  two  clearly  identifiable  concentrations  of  video  pel  values.  When  the 
Gray  scale  photograph  portion  of  the  facsimile  test  chart  is  used,  the  resulting  histogram 
clearly  does  not  show  the  bilevel  behavior  (see  fig  B 1 5). 


CONCLUSIONS  AND  SUMMARY 

1.  The  frame  store  memory  and  memory  controller  are  performing  all  the  operations 
required  by  the  design  goals. 

2.  Speed  of  operation  of  10.5  megapels  per  second  has  not  quite  been  met.  Data 
can  be  accommodated  safely  to  about  9.6  megapels  per  second.  The  cause  of 
the  limitation  is  known  and  can  be  corrected  in  the  equipment  if  and  when  a 
10.5  megapel  per  second  data  rate  is  needed. 

3.  The  method  of  expanding  the  system  to  control  eight  frame  store  memories 
rather  than  one  is  a low-risk  engineering  design  augmentation. 

4.  The  successful  operation  of  the  frame  store  memory  and  memory  controller 
demonstrates  the  feasibility  of  capturing,  storing,  and  buffering  high-resolution 
image  data  at  the  required  20  pages  per  second  data  rate. 

5.  The  compression  of  64  linear  brightness  levels  to  32  logarithmic  levels  and  the 
generation  of  pel  brightness  statistics  and  histograms  by  the  memory  controller 
under  software  program  control  demonstrate  the  flexibility  and  processing 
power  of  the  equipment. 


PLANNED  NELC  FUTURE  ACTIVITIES 


The  frame  store  memory  and  its  controller  will  be  used  as  a principal  part  of  a 
video  image  acquisition,  storage,  and  processing  system.  There  are  a number  of  ongoing 
activities  which  will  be  supported  by  the  image  acquisition  system.  These  include 
support  of  solid-state  scanning  device  testing,  the  gathering  and  analysis  of  image  statis- 
tics, the  evaluation  of  techniques  potentially  useful  in  image  compression  and  enhance- 
ment, as  well  as  others.  The  frame  store  memory,  its  controller,  and  the  associated 
peripheral  hardware  will  provide  the  necessary  vehicle  by  which  the  applicability  of 
scanning  devices  and  processing  algorithms  to  high-speed  image  capture  and  transmission 
can  be  determined. 
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Figure  B 1 5.  Part  ol  IFHF  facsimile  test  chart  and  histogram  (gray  scale). 


SOLID-STATE  SCANNER  TESTING 


The  memory  and  controller  will  be  used  on  a continuing  basis  to  support  the 
detailed  testing,  characterization,  analysis,  and  development  of  solid-state  image  scanners. 
Both  area  and  line  arrays  will  be  evaluated.  The  supporting  hardware  and  interfaces  are 
sufficiently  versatile  to  allow  continued  support  of  the  scanner  testing  effort.  Results 
gained  in  early  testing  with  the  CCDl  10  256-pel  scanner  will  be  amplified  by  installing 
a 1728-pel  line  scanner  (the  Fairchild  CCD  121).  Subsequently  to  the  evaluation  of  the 
long  linear  scanner,  an  area  device  will  be  installed  in  image  tracking  mode  and  evaluated. 


STATISTICAL  DATA  ACQUISITION  AND  PROCESSING 

Once  the  electro-optical  characteristics  of  scanning  devices  have  been  tested  and 
characterized,  the  devices  will  be  used  as  image  acquisition  sensors  to  acquire  complete 
8 1 /2-by-ll-inch  video  images.  These  images  will  be  stored  on  magnetic  tape  in  digital 
form  for  further  processing.  The  memory  controller  and  its  peripheral  hardware  will 
compute  a wide  variety  of  image  statistics  using  the  images  scanned  by  solid-state  scanners 
and  stored  on  magnetic  tape.  The  image  statistics  will  be  presented  in  both  tabular  and 
graphical  form  to  aid  the  characterization  of  image  types.  Examples  are  the  image  inten- 
sity statistics  and  associated  bar  graphs  in  figures  B13,  B14,  and  B15.  More  complicated 
types  of  statistics  or  perhaps  combinations  of  statistics  may  be  used  to  evaluate  processing 
algorithms  for  the  purpose  of  dynamically  controlling  the  analog  scanning  hardware. 


ENHANCEMENT  AND  COMPRESSION  TECHNIQUES 

The  processed  statistical  data  may  be  used  to  predict  the  compressibility  of  the 
video  image.  An  attempt  will  be  made  using  the  statistical  data  and  perhaps  other 
processes  to  predict  whether  or  not  a particular  type  of  image  is  compressible  or  en- 
hanceable.  Various  compression  and  enhancement  algorithms  may  be  tested  to  determine 
the  accuracy  of  predictions. 


SPECIFIC  TASKS 

1.  Interface  with  the  Kennedy  Tape  Transport  which  is  due  at  the  end  of  May. 

2.  Continue  to  improve  the  supervisory  software  controls  so  that  such  commands 
as  CLEAR,  LOAD  PROGRAM  (S),  CAPTURE,  ANALYZE  (with  options), 
DISPLAY  IMAGE,  DISPLAY  TABULAR  STATISTICS,  PRINT  TABULAR 
STATISTICS,  DISPLAY  GRAPHIC  STATISTICS,  PRINT  GRAPHIC  STATISTICS 
(at  low  resolution),  READ  IMAGE  FROM  TAPE,  etc,  are  simple  one-  or  two- 
pushbutton  commands. 

3.  When  a well  defined  procedure  for  analysis  is  established  in  June,  connect  the 
macroprograms  above  in  sequences  for  rapid  acquisition  of  image  test  data. 
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4. 


Consider  the  acquisition  of  a second  frame  store  memory  module  (about  $20k 
material  cost)  to  verify  the  expansion  capability  and  logic  design. 


5.  Consider  modification  of  packing  and  unpacking  logic  to  allow  program  control 
of  number  of  bits  accepted  per  video  pel  word. 

6.  Implement  a program  to  store  images  on  magnetic  tape  in  a format  which  is 
compatible  with  facilities  capable  of  producing  full  8 1 /2-by- 1 1 -inch  high-resolution 
prints.  Potential  sources  are  the  Image  Processing  Institute  at  USC  in  Los  Angeles; 
and  Perkin  Elmer  Company  in  Pasadena,  California. 


APPENDIX  A (TO  TR  2020  APPENDIX  B):  MICROPROGRAMMING 


MICRO  INSTRUCTION  FIELD  DECODE 


Field 

n-word  bits 

Code  (Binary) 

Function 

AC 

06-00 

- 

See  3001  data  sheet  (next  address) 

FC 

10-07 

— 

See  3001  data  sheet  (flag  control) 

F 

17-11 

— 

See  3002  data  sheet  (function  code) 

K 

19-18 

0 0 

K = all  zeros 

0 1 

K = KX* 

1 0 

1 1 

K = all  ones 

MDB  enables 

22-20 

0 0 0 

NOP 

0 0 1 

AC  - MDB 

0 1 0 

0 1 1 

1 0 0 

1 0 1 

1 1 0 

1 1 1 

SDB  - MDB 

SDB  enables 

25-23 

0 0 0 

NOP 

0 0 1 

Memory  -*•  SDB 

0 1 0 

Input  Logic  -+  SDB 

0 1 1 

Aux  I/O  -*>  SDB 

1 0 0 

Data  Switches  -*■  SDB 

1 0 1 

1 1 0 

1 1 1 

MDB  -*  SDB 

Memory 

27-26 

0 0 

NOP 

Control 

0 1 

WRITE 

1 0 

READ 

1 1 

REFRESH  REQUEST 

Clock  Control 

29-28 

0 0 

NOP 

0 1 

Set  HS  Clk-Enable  TTL  /urn 

1 1 

Set  MS  Clk-Enable  MOS  /urn 

1 0 

Set  EX  Clk-Enable  TTL  *im 

* x specified  by  EFBi_io 


Field 


Function 


u-word  bits 
30 


Function 

NOP 

Inhibit  CPE  clock 


0 

0 

0 

0 

NOP 

0 

0 

0 

1 

Set  “Step  Macro” 

0 

0 

1 

0 

Capture 

0 

0 

1 

1 

0 

1 

0 

0 

0 

1 

0 

1 

Clear  Front  Panel 

0 

1 

1 

0 

!R(Rn) 

0 

1 

1 

1 

IR  (Sensen) 

1 

0 

0 

0 

Vertical  Sync 

1 

0 

0 

1 

IR  (Kn) 

1 

0 

1 

0 

I/O  Strobe  (IOS) 

1 

0 

1 

1 

1 

I 

0 

0 

1 

1 

0 

1 

1 

1 

1 

0 

1 

1 

1 

1 

0 

0 

0 

0 

NOP 

0 

0 

0 

1 

Display  Cycle  Start  (DCS) 

0 

0 

1 

0 

SPX  - MDB 

0 

0 

1 

1 

N -*■  FO,  3 

(N) 

0 

1 

0 

0 

SPX  -*  IR 

0 

1 

0 

1 

Memory  Protect 

(M  PROT) 

0 

1 

1 

0 

Data  available  out 

(DAO) 

0 

1 

1 

1 

Boot  TAPE 

1 

0 

0 

0 

Horizontal  sync 

1 

0 

0 

1 

Data  Ready  for  TAPE  (DRT) 

1 

0 

1 

0 

1 

0 

1 

1 

1 

1 

0 

0 

1 

I 

0 

1 

1 

1 

1 

0 

1 

1 

1 

1 
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Field  M-word  bits  Code  (binary)  Function 


MARB  40-39  0 0 

0 1 
1 0 
1 1 

TEST  ENABLE  45-41  0 0 0 0 0 

0 0 0 0 1 
0 0 0 10 
0 0 0 11 
0 0 10  0 
0 0 10  1 
0 0 110 
0 0 111 

0 10  0 0 
0 10  0 1 
0 10  10 
0 10  11 
0 110  0 
0 110  1 
0 1110 
0 1111 

10  0 0 0 
10  0 0 1 
10  0 10 
10  0 11 
10  10  0 
10  10  1 
10  110 
10  111 

110  0 0 
110  0 1 
110  10 
110  11 
1110  0 
1110  1 
11110 
11111 


NOP 

MAR  -»  MARB 

MDB  -*•  MARB  (MDBM) 

CO/RO 
SENSE  1 
SENSE  2 
SENSE  3 
SENSE  4 
SENSE  5 

SCANNER  DA  (DA) 

MAN  FI 

TRUE 
MDB47 
RUN 
Flag  out 

LINE  SYNC  (Scanner)  (LS) 

«n 

DSR24 

MDBq 

I/O  status 
WAIT  (tape) 

Tape  gap  detected  (TGD) 

Read  data  strobe  (RDS) 
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MACRO  INSTRUCTION  SUMMARY 


OPCODE 

MNEMONIC 

FUNCTION 

OPCODE 

MNEMONIC 

FUNCTION 

200 

LDA 

Load  A 

240 

SRO 

Shift  A right,  1 fill 

201 

LDAX  (x) 

Load  A indexed 

241 

SRZ 

Shift  A right,  0 fill 

202 

STA 

Store  A 

242 

SLZ 

Shift  A left,  0 fill 

203 

STAX  (x) 

Store  A indexed 

243 

SRC 

Shift  A right,  circular 

204 

LDX  (x) 

Load  index 

244 

AND 

Logical  AND 

205 

STX  (x) 

Store  index 

245 

IOR 

Logical  OR 

206 

LSP 

Load  stack  pointer 

246 

XOR 

Logical  XOR 

207 

LDK  (x) 

Load  K-register 

247 

COM 

Complement 

210 

CAPT 

Capture 

250 

ADD 

Add  A 

211 

CLX  (x) 

Clear  index 

251 

SUB 

Subtract  A 

212 

INX(x) 

Increment  index 

252 

INC 

Increment  A 

213 

DXC  (x) 

Decrement  index 

253 

DEC 

Decrement  A 

214 

DSZ  (x) 

DCX,  skip  0 result 

254 

CLA 

Clear  A 

215 

D1SP 

DISPLAY 

255 

216 

HALT 

HALT 

256 

SMC 

Set  MOS  Clock 

217 

NOP 

Null  operation 

257 

220 

JP 

Jump  unconditional 

260 

MPR  (Y) 

Memory  Protect 

221 

261 

TRAX  (x) 

Transfer  (A)  to  index 

222 

262 

TRXA  (x) 

Transfer  (index)  to  A 

223 

JNN 

Jump  A > O 

263 

PUSH 

(A)  placed  on  TOS 

224 

JPN 

Jump  A < O 

264 

POP 

(TOS)  placed  in  A 

225 

JPZ 

JUMP  A = 0 

' 265 

LDAC 

Load  A with  contant 

226 

JNZ 

Jump  A = O 

266 

ADDC 

Add  constant  to  A 

227 

267 

SUBC 

Subtract  constant  from  A 

230 

270 

CAPL 

Capture  Line 

231 

JPX  (x) 

Jump  indexed 

271 

OUTV  (x) 

Output  Video  on  ch  x 

232 

JPA 

Jump  A 

272 

233 

BYT 

Shift  right  8 bits 

273 

INPT  (x) 

Input  from  tape  ch  x 

234 

JPI 

Jump  indirect 

274 

OUTT  (x) 

Output  to  tape  ch  x 

235 

JPR 

Jump  subroutine  return 

275 

INP  (x) 

Input  on  ch  x 

236 

JSR 

Jump  to  subroutine 

276 

OUT  (x) 

Output  on  ch  x 

*237 

SKIP 

Skip  on  Skip  x set 

277 

SIOC  (x) 

Skip  on  I/O  cond. 

(x)  indicates  modifier  sensitive 


* not  yet  implemented 

TOS  = top  of  stack 


PROGRAMMING  NOTES 


Rg  and  R7  contents  are  altered  during  the  course  of  certain  instructions. 

Before  executing  a program,  stack  pointer,  Rg  should  be  set  to  desired  first  stack 
location. 

All  arithmetic  and  logical  instructions  leave  the  result  in  the  accumulator. 

Interrupt  sequence  assumes  handling  routine  to  be  resident  at  location  0 in  pro- 
gram storage. 

Memory  protect  is  program-accessible  only  in  that  it  protects  those  portions  of 
memory  designated  by  front  panel  switches  on  invocation  of  MPR  instruction. 
Unless  this  effect  is  required,  MPR  should  be  used  only  from  front  panel.  Mem- 
ory protect  does  not  protect  against  loss  of  refresh  or  loss  of  power. 

Any  interrupt  handling  routine  must  end  with  POP  and  JPR  to  restore  to  entry 
conditions. 


MACRO  INSTRUCTION  FORMAT 


47  46 
□: 

39  38  36  35  2524  23 

°"  | X |4 BS H 

18  16  15 

TT 

0 

1 

NOT 

USED 

rr 

NOT 

USED 

() 

contents  of 

A 

= 

accumulator 

— ► = 

Replaces  contents  of 

Rx 

= 

index  register  x 

AT 

AC  and  T 

Y 

= 

address  or  constant 

jump  = 

transfer  program  control 

P 

= 

program  address  register  (R9) 

S 

= 

stack  pointer  (Rg) 

SKX 

= 

Skip  X 

Ai 

= 

accumulator  bit  i 

Bs 

= 

buffer  size 

F 

= 

Front  panel  fetch 

B 

= 

Byte  Select 

IB/ 

= 

Byte  Select  Inputs  (octal) 

MACRO  INSTRUCTIONS 


OP  CODES 

MNEMONIC 

FUNCTION 

DESCRIPTION 

200 

LDA 

(Y)-A 

Load  accumulator 

201 

LDSX  (x) 

(Rx  + Y)-  A 

Load  acc.  with  contents  of 
Rx  + Y 

202 

STA 

A Y 

Store  contents  of  act  in  memory 
location  Y 

203 

STAX  (x) 

A Y + Rx 

Store  contents  of  ace  in 
memory  location  (Y  - Rx 

204 

LDX  (x) 

(Y)  -*•  Rx 

Load  index  Rx  with  contents 
of  Y 

205 

STX  (x) 

Rx-Y 

Store  contents  of  Rx  in 
memory  location  Y 

206 

LSP 

00 -S 

Load  stack  pointer  with 
stack  beginning  location 

207 

LDK  (x) 

(Y)  -*■  Kx 

Load  Kx 

210 

CAPT 

Initiate  capture  routine  in 
TTL  Roms 

211 

CLX  (x) 

°-Rx 

Clear  index  Rx 

212 

INX  (x) 

Rx  + 1 Rx 

Add  1 to  contents  of  Rx 

213 

DCX  (x) 

Rx-i-Rx 

Subtract  1 from  contents  of  Rx 

214 

DSZ  (x) 

Rx  - 1 Rx 
P+  1 -+P 

Subtract  1 from  contents  of  Rx 
skip  the  following  instruction 

215 

DISP 

Initiate  the  DISPLAY  routine 
in  TTL  Roms 

216 

HALT 

Sets  STEP  MACRO  and 
stops  MCU  clock 

217 

NOP 

No  operation 

220 

221 

222 

JP 

Y -*•  P 

Transfer  program  control  to 
location  Y 

223 

JNN 

if  A 3®  O 
Y ->  P 

If  contents  of  accumulator 
is  not  negative  (>0)  then 
jump  to  Y 

224 

JPN 

if  A <0 

If  contents  of  accumulator 
is  negative  (<0)  then  jump 
to  Y 

225 

JPZ 

if  A = O 
Y ->  P 

If  contents  of  accumulator 
is  zero  then  jump  to  Y 

» 
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OP  CODE 8 

MNEMONIC 

FUNCTION 

DESCRIPTION 

226 

227 

230 

JNZ 

if  A *0 
Y -*■? 

If  contents  of  accumulator 
is  not  zero  then  jump  to  Y 

231 

JPX  (x) 

Rx  + Y - P 

Jump  to  location  specified  by 
sum  of  the  contents  of  Rx  and 
v 

232 

JPA 

A -<•  P 

1 

Jump  to  location  specified  by 
the  contents  of  the  accumulator 

233 

BYT 

Aj  -*■  Aj_g  (mod47) 

Shift  accumulator  right  8 bits 

234 

JPI 

(Y)-P 

Jump  to  location  specified  by 
the  contents  of  Y 

235 

JPR 

( (S)  ) — P 

(S)  - 1 — s 

Jump  to  location  specified 
by  the  stack  pointer  s subtract 
1 from  the  contents  of  s 

236 

JSR 

P-*(S) 

Y-»P 

Store  next  instruction  location 
on  top  of  stack  specified  by 
contents  of  S jump  to  Y 

*237 

SKIP 

if  SKX 
P+  1 -<-P 

If  skip  x has  been  set  the  skip 
following  instr. 

240 

SRO 

Ai  Ai-Y 
1 -*•  A47  ~ A47-Y 

Shift  contents  of  accumulator 
right  Y bits  and  fill  left  end  of 
accumulator  with  1 ’s 

241 

SRZ 

Ai  ^ Ai-Y 
0 -*•  A47-A47.Y 

Shift  contents  of  accumulator 
right  Y bits  and  fill  left  end  of 
accumulator  with  O’s 

242 

SLZ 

Ai~*  Ai  + Y 
0->  aq- Ay-1 

Shift  contents  of  accumulator 
left  Y bits  and  fill  right  end  of 
accumulator  with  O’s 

243 

SRC 

Ai  Ai-Y 
mod47 

Shift  contents  of  accumulator 
right  Y bits  and  fill  left  end  of 
accumulator  with  the  Y bits 
shifted  off  right  end 

244 

AND 

A A (Y)  ->  A 

Logically  AND  the  contents  of 
the  accumulator  with  the 
contents  of  Y 

245 

IOR 

A V (Y)  -*■  A 

Logically  OR  the  contents  of 
the  accumulator  with  the 
contents  of  Y 

246 

XOR 

A + (Y)  -►  A 

Logical  exclusive-or  of  the 
contents  of  the  accumul  and 
the  contents  of  Y 

MNEMONIC 


OP  CODEg 


FUNCTION  DESCRIPTION 


247 

COM 

A-»  A 

Logically  complement  the 
contents  of  the  accumulator 

250 

ADD 

A + (Y)  -*■  A 

Add  the  contents  of  Y to  the 
contents  of  the  accumulator 

251 

SUB 

A - (Y)-*  A 

Subtract  the  contents  of  Y 
from  the  contents  of  the 
accumulator,  leaving  a 2’s- 
complement  result 

252 

INC 

A + 1 ->■  A 

Add  one  to  the  contents  of 
the  accumulator 

253 

DEC 

A-  1 -*•  A 

Subtract  one  from  the  contents 
of  the  accumulator 

254 

CLA 

0- A 

Set  the  contents  of  the 
accumulator  to  zero 

255 

256 

SMC 

Set  MOS  clock 

257 

260 

MPR  (Y) 

Y -*•  MP  Register 

The  individual  1 6ths  (4k)  of 
main  memory  for  which  those 
bits  in  Y are  set  are  write 
disabled 

261 

TRAX  (x) 

A Rx 

Contents  of  accumulator  are 
copied  into  index 

262 

TRXA  (x) 

RX^A 

Contents  of  index  are  copied 
into  accumulator 

263 

PUSH 

A -*  (S) 
S+  1 -*  S 

Contents  of  accumulator  are 
copied  onto  top  of  stack  and 
stack  pointer  is  incremented 

264 

POP 

((S))-A 
S-  1 ->S 

Contents  of  top  of  stack  are 
copied  into  accumulator  and 
stack  pointer  is  decremented 

265 

LDAC 

Y- A 

Load  Y into  accumulator 

266 

ADDC 

A + Y -+  A 

Add  Y to  accumulator 

267 

SUBC 

A- Y->  A 

Subtract  Y from  accumulator 

270 

CAPL 

Capture  line 

Capture  one  line  from  the 

video  scanner  for  the  number 
of  words  specified  by  the  con- 
tents of  R7  and  store  at  address 
specified  by  Y 
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OP  CODEg 

MNEMONIC 

FUNCTION 

DESCRIPTION 

271 

OUTV  (x) 

Output  video 

Place  one  video  record  on  tape 
channel  x,  beginning  at  location 
Y in  memory,  and  continuing 
for  the  number  of  words  speci- 
fied by  the  contents  of  R^.  Re- 
quires the  constant  7 to  be  in  R-> 
and  77  to  be  in  K3. 

272 

273 

INPT  (x) 

Read  tape  buffer 

Transfer  the  record  immediately 
following  current  position  from 
tape  on  channel  x to  a buffer 
beginning  at  location  Y. 

274 

OUTT  (x) 

Write  tape  buffer 

Transfer  the  contents  of  a 
buffer  beginning  at  location 
Y and  ending  at  location  Y + S - 1 
to  tape  on  channel  x 

275 

INP  (x) 

(l/0ch)x  - Y 

Input  one  word  on  I/O  channel 
x to  memory  location  Y 

276 

OUT  (x) 

(Y)  -*■  I/O  chx 

Output  one  word  from  memory 
location  Y on  I/O  channel  x 

277 

SIOC  (x) 

Skip  on  I/O 

If  I/O  condition  x is  met,  then 

condition 

skip  next  instruction  (see  table 
2 on  following  page) 

table  1 : 

I/O  channels 

X 

device 

0 

none 

1 

CRT  Terminal 

2 

Tape  I (Bright) 

3 

4 

5 

Video  analyzer 

6 

Tape  2 (Kennedy) 

7 

L* 
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table  2:  SIOC  functions 


X. 

function 

0 

none  (skip  always) 

1 

TERMINAL  DATA  READY 

2 

TERMINAL  BUSY 

3 

File  Mark  (Bright  Tape) 

4 

Scanner  Data  Available 

5 

6 

7 

AUXILIARY  OP  CODES 


(those  routines  not  normally  recognized  as  op  codes  but  which  may  be  used  as 
such) 


OPCODE 

FUNCTION 

COMMENTS 

006 

EXAMINE 

Y -*  R7;  ( (R7) ) -*•  Display 

007 

EXAMINE  NEXT 

R7  + 1 R7;  ( (R7) ) Display 

017 

FETCH 

030 

DEPOSIT 

(FP)*  -*•  (R7);  Examine  Next 

135 

SET  AC 

(FP)  -*  A 

137 

SET  Rn 

(FP)->Rn** 

175 

DISPLAY  AC 

(A)  -*■  Display 

177 

DISPLAY  Ra 

(Rn)**-»  Display 

000 

FAULT 

360 

BOOT 

377 

INTERRUPT 

* FP  = front  panel  data  switches 

**  n is  10-digit  lever  switch;  Acc  value  is  lost  when  used  in  this  mode 


BA- 10 


ROM  FLOWCHART  FORMAT 


’octal  representation 
OF  m-MEMORY  location 


200 


Assembly  language 

/MNEMONIC  FOR  MACRO- 
INSTRUCTION 

LDA  80 


'’hexadecimal 

REPRESENTATION 
OF  (j-MEMORY 
LOCATION 


6K  INPUT  CONTROL 


6SYSTEM  CONTROL 
MNEMONICS 


notes: 

1.  optional 

2.  appears  only  at  first  microword  of  a macroinstruction 

3.  leading  zero  not  given  for  first  256  locations 

4.  see  3002  data  sheet  for  function.  Parentheses  indicate  register  operated  on 

5.  see  3001  data  sheet  for  function 

6.  see  attached  sheets  for  function  description 

A.  Flag  input  is  specified  only  if  not  the  default  condition  HCZ  and  then  appears 
with  system  control  or  flag  out  and  K-control. 

Default  conditions  (if  not  specified  on  flowchart) 

CPE  op  code  — NOP 

Flag  out  - FFO 

Flag  in  - HCZ 

System  cont.  - none 
Test  mux  — CO/RO  - true  value 
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INTRODUCTION 


1 

This  report  contains  data  on  scanning  devices,  the  test  beds,  and  illumination  sources 
generated  since  the  first  anniversary  date  of  the  program,  22  October  1975.  Since  that  date 
there  have  been  no  new  off-the-shelf  candidate  imaging  devices  from  any  of  the  major  sup- 
pliers which  are  directly  applicable  to  the  USPS  requirements. 

Consequently,  NELC,  with  the  approval  of  the  USPS  Design  Division,  has  initiated  a 
contract  with  RCA,  Princeton,  which  if  successful  will  provide  design  data  for  a solid-state 
imaging  device  meeting  all  the  USPS  imaging  goals.  Actual  test  devices  which  are  some- 
what smaller  in  area  will  be  fabricated,  evaluated,  and  submitted  to  NELC  for  further  tests. 

The  general  goals  of  this  contract  are  contained  in  the  body  of  this  report.  The  proprietary 
details  of  the  contracted  work  are  contained  in  TR  2020  Volume  2,  distribution  of  which 
is  limited  to  US  Government  agencies. 

During  this  program  year  an  entirely  new  large  drum  test  bed  has  been  fabricated 
and  operated,  and  is  integrated  into  the  total  aquisition  system.  A new  method  of  illum- 
ination has  been  added  which  utilizes  flourescent  tubes  rather  than  an  incandescent  source. 

A 1728-pel  imager  has  been  integrated  into  the  system  in  order  to  accommodate  full  8V2- 
inch  copy  width  acquisition. 

Test  plans  have  been  formulated  for  the  calibration  of  the  system  and  the  acquisition 
of  full-page  data  for  the  data  compression-study  which  will  begin  almost  immediately.  This 
report  contains  the  detailed  techniques  and  calculations  of  lens  distances,  illumination 
correction  methods,  area  scanner  aberrations,  and  the  plan  to  utilize  them. 


RELEVANCE  TO  DoD  MISSION 

There  are  many  similarities  between  USPS  imaging  goals  and  some  desired  military 
objectives.  In  the  USPS  concept,  the  imager  remains  at  rest  while  the  “targets,”  the  pages  of 
copy,  move  rapidly  past  the  field  of  view.  Land-based  military  applications  may  utilize  the 
same  approach  for  battlefield  surveillance  or  intrusion  detection.  The  greater  military  in- 
terest appears  to  lie  where  the  sensor  is  in  motion  (and  perhaps  the  target).  The  most  likely 
airborne  applications  are  teleguidance  and  telereconnaissance.  A “tracking”  imaging  device 
such  as  the  one  being  developed  at  RCA  laboratories  will  offer  some  definite  design  advan- 
tages to  systems  in  which  relative  motion  exists  between  the  imaging  system  and  the  target. 

DRUM  SCANNER  TEST  BEDS 


SMALL  DRUM  TEST  BED 


PHYSICAL  DESCRIPTION 

The  small  drum  test  bed  (SDTB)  was  built  for  dynamically  evaluating  line  scanner 
devices  and  to  provide  input  data  for  the  image  analyzer  and  frame  store  memory.  Figure  Cl 
shows  most  of  the  major  components.  Each  major  part  is  described  briefly  in  the  following 
paragraphs. 


SCANNER  BENCH.  This  part  consists  of  a 14-by-32-by 3/4-inch  plate  serving  as  the 
bench  top  and  two  5-by-31  -by- 1 /2-inch  rails  used  as  legs  for  the  bench.  These  three  parts 
weigh  about  45  pounds,  making  a good  stable  platform  for  the  other  components. 

ILLUMINATION  SOURCE.  A Dest  Data  projector  is  used  for  the  illumination 
source.  As  originally  built,  it  used  two  500-watt,  120-volt  halogen  lamps  (500T30/CL/U) 
mounted  end  to  end  to  give  a line  of  illumination  about  8 inches  long.  These  lamps  were 
replaced  with  one  1500-W,  240-V  lamp  (1500T30/CL/U-240)  which  was  twice  as  long.  The 
projector  focused  the  light  about  3 inches  from  the  source  in  its  original  form.  The  optical 
path  of  the  projector  was  modified  to  make  the  focal  distance  about  9 incl'.es,  so  that  there 
is  adequate  working  distance  to  mount  the  projector  on  the  bottom  side  of  the  bench  top. 
The  projector  also  contains  a rectifier  and  filter  network  so  as  to  provide  dc  voltage  to  the 
lamps  and  a “muffin”  fan  to  cool  the  unit.  The  air  flow  is  such  that  air  enters  the  lamp 
housing  at  one  end  of  the  lamp  and  exits  at  the  other.  The  brightness  is  controlled  by  a 
1 0-ampere  Variac. 

DRUM  AND  MOTOR.  The  drum  was  constructed  with  a circumference  of  1 2 in- 
ches, which  allowed  for  1 1 inches  of  paper  length  and  1 inch  of  gap  between  pages.  The 
motor,  an  1800-rpm  hysteresis  synchronous  type,  and  pulleys  give  lps  (letters  per  second) 
rates  of  20,  10,  and  5.  The  drive  belt  was  made  from  1 /8-inch  O-ring  rubber  glued  together 
with  Eastman  cement.  The  bearings  are  of  a standard  commercial  grade.  The  weight  of  the 
drum  is  about  1 1 pounds. 

CIRCUIT  BOARD  ENCLOSURE.  Data  flow  for  the  acquisition  of  images  using  CCD 
arrays  is  shown  in  figure  C2.  The  scanner  and  drive  module  are  mounted  immediately  behind 
the  lens  assembly.  The  electronics  enclosure  contains  five  modules  approximately  5-by-5- 
inches  on  a side.  These  cards  are  similar  to  the  Navy  Standard  Hardware  Program  (SHP) 
modules  except  that  they  are  twice  the  height.  Each  module  contains  80  connector  pins  and 
is  compatible  with  the  Navy  present  standard  electronic  module  (SEM)  program. 

The  five  modules  in  the  circuit  board  enclosure  are:  sample  and  hold  module,  analog- 
to-digital  converter  module,  input/output  module,  scanner  control  module,  and  a voltage  reg- 
ulator module  (not  shown  in  fig  C2). 

SCANNER  AND  DRIVER  MODULE.  The  solid-state  line  scanner  is  mounted  on  the 
lens-scanner  assembly  (fig  C3).  This  assembly  can  be  positioned  anywhere  from  about  6 to 
24  inches  from  the  drum.  This  allows  the  pels  per  inch  to  be  adjusted  over  a considerable 
range.  Some  lenses  used  do  not  have  built-in  focusing  so  the  assembly  may  also  be  moved 
for  fine  focus  adjustment.  Adapter  rings  were  made  to  accommodate  “C”  mount  lenses, 
a Nikon  bayonet  adapter  ring,  and  a 30-mm/l-mm  thread  for  a special  Nikon  copy  lens.  The 
line  scanner,  its  immediate  drive  circuitry,  and  the  output  video  amplifier  are  mounted  on 
the  back  side  of  the  scanner  module.  They  are  actually  fastened  to  a micarta  board  that  can 

Metrication  information:  1 in  = 25.4  mm 

1 lb  = 0.45  kg  (approx) 
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be  adjusted  vertically  so  that  the  imaged  area  is  exactly  normal  to  the  imager.  The  signals 
that  enter  or  exit,  including  power,  come  from  the  circuit  board  enclosure.  Data  from  the 
CCD  image  scanner  are  fed  through  a type  733  preamplifier  to  the  sample  and  hold  module 
in  the  electronic  circuit  board  enclosure. 


SAMPLE  AND  HOLD.  The  video  from  the  scanner  is  analog  in  amplitude  and  pulse 
in  time.  In  addition,  the  actual  data  pulses  are  interspersed  among  clocking  pulses.  In  order 
to  separate  the  actual  video  from  all  the  “noise”  and  to  stretch  the  pulses  for  later  usage,  a 
sample  and  hold  module  is  utilized.  The  actual  unit  used  is  a Datel  systems  SHM-UH  and  is 
mounted  in  the  circuit  board  enclosure.  The  acquisition  time  is  50  nanoseconds. 


A/D  CONVERTER  MODULE.  The  analog  data  coming  from  the  sample  and  hold 
module  are  converted  to  6-bit  digital  data  for  transmission  to  the  remote  processing  hard- 
ware. The  converter  used  is  a Datel  Systems  ADC-UH6B,  which  has  a conversion  rate  of 
10'  pels  per  second.  This  hardware  makes  up  another  card  in  the  circuit  board  enclosure. 


INPUT/OUTPUT  MODULE.  The  output  curcuitry  of  the  A/D  converter  is  not  ade- 
quate for  transmitting  the  high-speed  digital  data  to  the  remote  processing  cabinets.  National 
Semiconductor  75114  line  drivers  are  used  to  transmit  the  6-bit  digital  data. 


OPERATION 

This  test  bed  was  completed  and  put  into  operation  in  the  spring  of  1975.  It  was 
used  for  the  development  of  the  image  analyzer  and  frame  store  memory  hardware  contin- 
uously until  late  May  1976,  when  the  power  supplies  and  circuit  board  enclosure  were 
transferred  to  the  large  drum  test  led  (LDTB).  Various  aspects  of  its  performance  are 
discussed  in  the  paragraphs  that  follow. 


ILLUMINATION  PROFILE.  A uniform  white  test  target  was  put  on  the  scanner 
drum  and  the  illumination  from  the  Dest  Data  projector  was  measured  with  a Gamma  Sci- 
entific photometric  telescope  positioned  on  the  scanner  bench.  The  relative  intensity  was 
measured  along  the  axis  of  the  drum  and  perpendicular  to  the  axis  (along  the  circumference). 
Tabular  results  of  these  tests  are  given  in  appendix  A (to  this  appendix).  Figures  C4  and 
C5  show  the  results  of  the  tests.  Examination  of  figure  C4  reveals  two  problems:  more 
fall-off  of  intensity  on  one  side,  which  is  due  to  the  cold  air  blowing  over  that  end  first; 
and  a lot  of  ripple  in  the  illumination,  which  is  the  result  of  the  filament  support  wires  that 
are  just  over  1 / 2 inch  apart.  Figure  C5  shows  the  effects  of  the  wires  even  more  dramatically. 
Figure  C6  is  a compilation  of  both  the  horizontal  and  vertical  photometric  scanning  data. 

The  uneven  cooling  could  easily  be  changed  by  redesign,  but  elimination  of  the  filament 
support  wires  would  mean  a major  program  with  the  lamp  manufacturer. 


RELATIVE  ILLUMINATION  AMPLITUDE 


r 


Figure  C4.  General  profile  of  illumination  amplitude  vs  horizontal  position,  tungsten  source. 


Figure  C5.  Fine  detailed  profile  of  illumination  amplitude  vs  horizontal  position,  tungsten  source. 
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LARGE  DRUM  TEST  BED 


PHYSICAL  DESCRIPTION 

The  LDTB  (fig  C7  and  C8)  was  built  to  develop  and  dynamically  evaluate  more 
sophisticated  imager  techniques.  The  large-circumference  drum  and  shaft  encoder  features 
were  incorporated  in  order  that  advanced  tests  for  equipment  being  built  for  the  Postal 
Service  by  nongovernment  contractors  could  be  simulated.  The  major  components  of  the 
system  are  described  briefly  in  the  following  paragraphs. 

Some  parts  of  the  SDTB  were  used  on  this  test  and  will  not  be  described  again  ex- 
cept where  a modification  was  made.  These  parts  include  the  scanner  module;  the  circuit 
board  enclosure,  which  includes  the  sample  and  hold,  A/D  converter,  and  line  drivers;  and 
the  power  supplies  for  the  electronic  circuitry. 


SCANNER  BENCH.  The  bench  top  for  this  test  bed  is  14.5  by  45  by  0.9  inches. 
The  rails  used  as  legs  for  the  bench  top  are  8 by  43  by  0.5  inches,  and  the  total  weight  of 
the  three  parts  is  about  80  pounds,  making  an  even  more  stable  platform  than  the  original 
test  bed.  This  test  bed  will  allow  for  a working  distance  between  drum  and  scanner  of  over 
30  inches. 
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ILLUMINATION  SOURCE.  The  illumination  source  for  this  test  bed  is  two  special 
high-brightness  fluorescent  lamps.  The  initial  testing  is  being  done  with  some  1 22P99 
lamps  used  in  Xerox  copiers.  Later,  F18T8H  lamps  with  a mixture  of  red,  green,  and  blue 
phosphors  will  be  installed.  They  are  nominally  33-watt  lamps  in  15-watt  envelopes.  For 
use  with  the  high-speed  scanners,  the  lamps  must  be  operated  with  either  high-frequency 
ac  or  dc  power.  A dc  supply  is  used  in  this  system  and  is  mounted  below  the  drum. 

DRUM  AND  MOTORS.  The  circumference  of  the  drum  was  chosen  to  give  exactly 
0.005  inch  of  surface  movement  per  pulse  output  of  the  shaft  encoder.  With  8192  pulses 
per  revolution  from  the  encoder,  the  diameter  becomes  13.038  inches.  The  drum  is  hollow 
except  for  the  2.5-inch  average  diameter  of  the  shaft.  Even  so,  the  entire  drum  assembly  has 
a very  high  moment  of  inertia.  The  high  moment  of  inertial  and  the  usage  of  precision  ground 
bearings  should  yield  a very  smooth  running  test  bed. 

Two  motors  have  been  installed.  One  is  a 900-rpin  hysteresis  synchronous  motor 
that  can  drive  the  drum  at  20,  15,  10,  8,  6,  or  4 pps  by  selection  of  various  pulley  combina- 
tions. As  before,  O-ring  rubber  is  being  used  for  belting.  The  second  motor  is  1/2-rpm 
hysteresis  synchronous  gearhead  clock  motor.  Through  pulleys  this  motor  will  drive  the 
drum  at  the  rate  of  6 minutes  per  revolution,  or  about  1 .6  minutes  per  page. 

SHAFT  ENCODER.  A Baldwin  5V675HAZ  incremental  shaft  encoder  was  mounted 
on  the  drum  shaft.  This  encoder  has  a resolution  of  213,  or  8192,  pulses  per  revolution.  It 
also  puts  out  a sync  pulse  once  each  revolution.  It  is  an  optical  type  with  very  good  pre- 
cision. Detailed  specifications  are  given  in  appendix  B (to  this  appendix). 

IMAGER  MODULE.  The  same  scanner  module  that  was  used  on  the  SDTB  is  used 
on  this  test  bed  with  some  modifications.  A micropositioning  mechanism  was  added  for 
fine  focus  adjust  when  the  lens  being  used  does  not  have  a built-in  focusing  ring.  The  other 
modification  made  was  the  addition  of  a “quick  change”  mounting  technique  for  the  scan- 
ner and  circuit  board. 

OPERATION 

This  test  bed  was  completed  and  made  ready  for  system  development  work  during 
the  last  week  of  May  1976.  As  of  the  writing  of  this  report,  there  have  been  very  few  new 
data  developed  based  exclusively  on  its  usage;  therefore,  the  following  paragraphs  will  dis- 
cuss primarily  planned  testing. 

ILLUMINATION  PROFILE.  The  Xerox  copy  lamps  were  tested  for  uniformity  in 
March  1976  prior  to  ordering  the  special  lamps  from  Sylvania.  Figure  C9  shows  the  relative 
intensity  profile  for  one  of  the  Xerox  lamps.  The  maximum  intensity  change  of  about  Hr 
over  the  center  8.5  inches  is  decidedly  better  than  the  3 0%  drop-off  experienced  with  the 
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Figure  C9.  General  profile  of  illumination  amplitude  vs  horizontal  position,  fluorescent  source. 


Dest  Data  projector  at  each  end  of  the  8.5-inch  span.  Furthermore,  the  intensity  transition 
from  one  end  to  the  other  is  perfectly  smooth  (one  lamp  tested  had  a phosphor  blemish, 
but  this  is  a quality  control  matter  as  opposed  to  a technique  problem),  whereas  the  halogen 
lamp  yielded  about  3%  intensity  variation  for  each  filament  support  wire. 

PLANNED  ILLUMINATION  CORRECTION.  The  initial  attempts  at  illumination 
correction  will  be  made  in  software  programs  using  the  frame  store  memory  and  memory 
controller.  It  is  anticipated  that  this  will  be  a slow  and  laborious  process,  since  it  may  be 
necessary  to  use  the  magnetic  tape  deck  for  retrieval  and  storage  of  uncompensated  and 
compensated  images.  A hardware  module  capable  of  real-time  operation  (21  megapels  per 
second)  has  been  designed  but  not  fabricated  for  future  compensation  studies. 

The  problem  of  nonuniformity  of  illumination  with  the  single- filament  quartz 
iodide  lamp  has  been  discussed  in  a previous  section.  The  promise  of  a much  more  uniform 
illumination  using  the  fluorescent  tube  envelopes  has  also  been  discussed.  There  are,  however, 
two  remaining  sources  of  nonuniformity  in  the  optieal-to-electrical  conversion  process.  One 
of  these  sources  is  the  nonuniformity  of  the  optical-to-electrical  conversion  and  the  charge 
transfer  efficiency  of  the  imaging  device  itself.  This  will  be  discussed  in  a later  section.  An- 
other contributor  to  optical  nonuniformity  is  related  to  the  quality  and  positioning  of  the 
lens  assembly  itself. 

Appendix  C (to  this  appendix)  includes  the  calculation  for  the  employment  of  a 
55-mm  photographic  lens.  This  lens  is  the  f3.5  Micro  Auto  Nikkor  P55.  This  lens  is  one 
of  the  sharpest  lenses  available  in  35-mm  photography  with  a very  high  center-to-edge  re- 
solving power.  It  is  equally  applicable  for  its  extreme  flatness  of  field  and  high  image  con- 
trast. Lenses  having  all  the  foregoing  attributes  will  be  required  in  order  to  provide  the 
image  fidelity  stated  in  the  Postal  Service  goals. 


C-l  5 

L * u 


I 


1 

The  calculations  in  appendix  C show  that  if  a 55-mm  lens  is  used  in  conjunction  with 
8.5-inch  copy  material  and  a Fairchild  CCD121  line  imager  having  an  optical  aperture  of  0.890 
inches,  then  the  distance  from  the  lens  to  the  copy  material  on  the  drum  is  22.85  inches.  For 
this  lens-object  distance  there  exists  an  angle  of  1 0.54  degrees  to  each  side  of  the  centerline 
of  the  lens  in  order  to  accommodate  the  full  8.5-inch  width  of  the  copy.  The  cosine  of  this 
angle  is  0.983  and  the  fourth  power  of  this  angle  is  0.934.  This  is  the  well  known  “cosine 
fourth”  law  discussed  in  the  first  annual  Postal  Service  report.  In  this  instance,  the  law  simply 
states  that  with  uniform  illumination,  the  intensity  of  the  real  image  formed  by  the  lens  will 
have  only  93.42%  of  the  intensity  at  the  edges  of  an  8‘/2-inch  page  with  respect  to  the  page 
center  intensity.  This  is  a droop  of  6.58%  (or  ±3.29%). 

One  method  which  can  circumvent  this  variation  in  intensity  is  to  move  the  lens  assem- 
bly back  from  the  copy  until  the  angle  subtended  is  small  enough  so  that  the  variation  is  less 
than  one  of  the  amplitude  quanta  required  in  the  acquisition  process.  For  this  purpose,  then, 
let  us  assume  that  the  data  are  to  be  acquired  in  64  equal-amplitude  illumination  levels.  Then 
we  wish  to  maintain  a fidelity  of  at  least  63/64  of  this  center  illumination  at  the  edges  in 
order  to  preclude  the  loss  of  data  at  these  points.  The  fraction,  then,  of  63/64,  or  0.984. 
must  equal  the  fourth  root  of  this  number  and  solving  for  the  cosine  gives  an  angle  of  5.08 
degrees.  Given  a copy  width  of  ±4.25  inches  and  an  angle  subtended  of  5.08  degrees,  it  can 
be  shown  that  the  lens  assembly  must  be  47.8  inches  away  from  the  copy. 

The  above  optical  calculation  only  satisfies  the  “cosine  fourth”  law  for  an  evenness 
of  illumination  to  better  than  plus  or  minus  1/2  Isb  brightness  amplitude.  Yet  all  the  other 
static  or  repetitive  errors  that  might  have  occurred  due  to  vignetting  of  the  lens,  unevenness 
of  original  illumination  at  the  copy,  and  unevenness  of  optical-to-electrical  conversion  and 
shift-out  of  the  image  data  still  remain.  Secondly,  it  is  now  necessary  to  procure  a high-quality, 
long-focus  lens  having  a flat  field  and  aplanatic  characteristics  which  are  suitable  for  line  and 

I,  area  tracking  imaging. 

An  investigation  has  been  made  into  the  alternate  methods  of  providing  corrections 
for  these  redundant  errors  in  the  image  acquisition  system.  The  simplest  strategy  devised  thus 
far  can  be  seen  in  figure  CIO.  This  method  requires  that  a calibration  scan  be  taken  with  a 
uniform  target  of  the  whitest  material  available.  For  our  application  we  have  selected  Fast- 
man  white  reflectance  paint  which  is  a barium  sulfate  (BaSO^)  mixed  with  a binder  material 
which  can  be  sprayed  onto  a rigid  bar  which  in  turn  can  be  bolted  to  the  test  drum.  The 
acquired  calibration  curve  may  have  an  appearance  similar  to  that  shown  in  figure  Cl  0a.  The 
values  of  pel  brightness  amplitude  as  shown  in  this  profile  are  digitized  to  6 binary  bits  as  the 
calibration  curve  is  obtained.  As  the  profile  is  obtained  the  6-bit  words  are  stored  in  a suitable 
storage  register  as  shown  in  figure  C 1 1 . 

Analog  input  data  are  presented  through  the  preamplifier  and  an  A/D  converter 
as  in  conventional  image  acquisition.  A branch  of  the  digitized  data  outputs  is  fed  to  the 
pseudorandom  shift  register  which  is  in  fact  a static  random  access  memory  (RAM).  In 
order  to  accommodate  at  least  1 700-pel  width  at  6 bits  per  pel,  it  is  necessary  to  provide  a 
static  RAM  with  at  least  this  capability.  In  the  figure,  a 2048-word  by  6-bit  shift  register 
is  shown.  For  our  design  goal  of  84  megapels  per  second  from  four  or  more  ports,  it  is 
necessary  for  the  data  acquisition  and  read-out  rates  to  be  at  21  megapels  per  second. 

A read  only  memory  (ROM)  table  of  2048  words  by  6 bits  is  placed  in  the  data 
path  in  such  a way  that  6 bits  from  the  analog-to-digital  converter  and  6 bits  from  the  out- 
put of  the  static  (RAM)  are  used  as  addressed  inputs. 
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STEP  1 . RUN  CALIBRATION  CURVE 
WITH  WHITEST  MATERIAL.  STORE 
SEQUENTIAL  VALUES  OF  REFLECTIVE 
BRIGHTNESS. 
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STEP  2.  RUN  ROUTINE  COPY  DATA. 
ACQUIRE  SEQUENTIAL  VALUES  OF 
REFLECTIVE  BRIGHTNESS. 


COMPUTE  C = 63  X COPY  B 
CALIB  B 


STEP  3.  DIVIDE  THE  COPY  BRIGHTNESS 
VALUES  AS  RECEIVED  BY  THE  STORED 
CALIBRATION  VALUES.  MULTIPLY  BY 
CONSTANT  = 63  AND  PIPELINE 
OUTPUT  TO  PRESTORAGE  PROCESSOR 
OR  FRAME  STORE  MEMORY. 
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STEP  4.  STORE,  PROCESS,  ANALYZE, 
AND/OR  DISPLAY  CORRECTED  RESULTS. 


Figure  CIO.  Illumination  correction. 
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Figure  Cl  1.  Acquisition  system,  block  diagram  including  illumination  correction. 


With  1 2 inputs  it  could  be  possible  to  provide  4096  individual  output  configurations 
of  data  which  would  be  programmed  and  stored  within  the  ROM.  It  is  possible  to  invoke 
two  simple  design  assumptions  which  will  greatly  save  capacity  of  the  ROM  lookup  table. 

The  first  is  to  assume  that  the  calibration  target  material  gives  higher  reflectance  than  any 
USPS  copy  material.  If  this  is  not  so,  we  have  chosen  the  wrong  calibration  material.  The 
second  assumption  is  that  the  droop  in  the  illumination  characteristics  will  never  exceed  50%. 
If  this  is  not  true,  then  the  illumination  source  should  be  redesigned.  If  these  two  assump- 
tions are  accepted,  it  is  possible  to  write  the  truth  table  for  the  contents  of  the  ROM  table. 
Contents  of  the  ROM  table  are  calculated  as  follows: 

incoming  video  value 

Compensated  output  value,  C = 63  X — — : — 

stored  calibration  video  value. 

In  effect,  the  ROM  is  programmed  to  perform  very-high-speed  6-bit  division  normal- 
ization of  values  as  received  from  the  imager  and  the  calibration  profile.  A copy  of  the  par- 
tially filled-in  ROM  truth  table  is  shown  in  figure  Cl  2.  Notice  the  fact  that  two  rules  which 
were  invoked  at  the  beginning  of  the  discussion  have  truncated  both  the  top  portion  of  the 
truth  table  and  50%  of  the  values  running  horizontally  across  the  table.  It  is  therefore  rela- 
tively easy  to  calculate  the  program  for  a set  of  ROMs  to  provide  this  very-high-speed  cali- 
bration correction  function. 

There  exist  very  few  high-speed  shift  register  devices  which  have  speed  and  capacity 
parameters  commensurate  with  this  logic  problem  of  storage  and  retrieval  of  the  calibration 
sample.  There  are,  however,  a few  RAM  devices  which  can  be  used  as  pseudo  shift  registers 
at  these  speeds. 
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Figure  Cl 2.  Calibration  of  ROM  table  values. 


Figures  Cl  3 and  Cl 4 show  a logic  block  diagram  and  the  timing  wave  forms  of  a 
variable-length,  high-speed  pseudo  shift  register.  This  approach  uses  1024-by-l  RAM  devices 
for  the  memory.  In  this  case,  Signetics  devices  type  N82S1 1 has  been  selected  as  the  storage 
device  for  this  application.  Since  this  drawing  was  made,  Signetics  and  a second  source,  Tele- 
dyne, also  now  provide  an  even  higher-speed  device,  the  N82S1 1 1. 

Although  these  are  very-high-speed  devices,  the  read/write  cycle  time  is  such  that  de- 
multiplexing is  necessary  in  order  to  reduce  the  read-modify-write  requirement  by  a factor 
of  two. 

The  complete  operation,  then,  for  using  the  calibrate  (illumination)  strategy  would 
be  as  follows: 

1 . The  brightness  profile  for  the  calibration  strip  is  stored  in  the  static  RAM  at 
6 bits  per  pel  digitized  resolution.  No  further  data  need  be  written  into  this  memory  until 
such  time  as  re  calibration  is  required. 

2.  As  routine  sheets  of  USPS  copy  are  fed  through  the  system,  values  of  the 
digitized  image  data  along  with  corresponding  values  ot  the  stored  calibration  curve  data  are 
presented  pel  by  pel  to  the  ROM  address  inputs. 

3.  Using  the  address  data  above,  the  ROM  provides  a 6-bit  compensated  output 
value,  which  is  used  for  further  prestorage  processing  and  buffer  storage. 

It  should  be  pointed  out  there  that  there  are  also  other  applications  for  a module 
which  will  hold  individual  digitized  lines  of  scanned  data.  The  illumination  calibration 
requirement  is  only  one  of  several.  Two  or  more  of  such  lines  of  data  probably  will  be  re- 
quired if  two-dimensional  edge  enhancement  techniques  are  ever  to  be  studied  or  accom- 
modated in  real  time.  A third  application  for  retaining  past  history  samples  ot  scanned  data 
is  for  two-dimensional  data  compression  techniques.  One  such  strategy  may  call  for  a mean- 
dering run  length  technique,  which  is  expected  to  increase  the  length  of  runs  appreciably. 
Another  possible  application  for  compression  is  in  the  use  of  differential  pulse  code  modu- 
lation (DPCM)  techniques  from  scan  line  to  scan  line.  There  probably  will  be  high  correla- 
tion in  the  direction  of  copy  motion  from  line  to  line  as  sample  pels  ot  typed  or  handwritten 
characters,  map  data,  or  to  some  extent  continuous  tone  pictures  are  scanned.  A block  dia- 
gram (fig  Cl  5)  shows  how  two  delay  line  modules  would  be  employed  to  provide  concurrent 
data  from  a presently  scanned  line  plus  the  two  previous  lines. 


SCANNERS  TO  BE  TESTED 

During  early  operation  of  the  SDTB,  the  test  bed  and  the  Fairchild  C ( D 1 10  scanner 
mounted  on  it  were  essentially  assumed  to  be  a test  signal  generator  and  the  remote  equip- 
ment was  the  items  under  development  and  test.  The  development  ot  the  remote  equipment 
has  progressed  to  the  point  at  which  it  now  serves  as  a test  facility  for  evaluating  scanners 
mounted  on  the  LDTB.  The  scanners  to  be  tested  and/or  operated  include: 

1 . Fairchild  CCD1 21 , a 1 728-element  linear  scanner 

2.  Fairchild  CCD  1 1 0,  a 256-element  linear  scanner 

3.  RCA  TCI  1 55  camera  with  a “surface  channel”  area  scanner  installed 

4.  The  same  RCA  TCI  1 55  camera  with  a “special”  area  scanner  installed 


C-20 


Figure  Cl  3.  Variable-length,  high-speed  pseudo  shift  register,  logic  block  diagram. 
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Figure  CIS.  Scan  sample  delay  lines, block  diagram. 

The  first  three  are  discussed  briefly  below.  The  fourth  is  described  at  more  length  in 
a separate  section. 


FAIRCHILD  CCD1 21.  TheCCD121  (1728  pels)  will  be  used  (after  all  circuitry  is 
debugged)  to  generate  full-page,  high-quality  images  for  storage  on  magnetic  tape.  The 
images  stored  on  the  magnetic  tape  can  then  be  used  as  test  signals  for  advanced  development 
of  enhancement  and  compression  techniques.  Information  is  being  formatted  on  the  tapes 
so  that  in  the  future  full-page  printouts  can  be  obtained  from  the  Image  Processing  Institute 
at  USC,  Perkin  Elmer  Company  in  Pasadena,  or  RCA  in  Camden,  NJ.  The  device  and  its 
driver  electronics  are  being  debugged  at  this  time. 

For  the  acquisition  of  data  using  the  Fairchild  CCD121  and  recording  the  images  on 
the  Kennedy  tape  deck,  theLDTB  scanning  drum  must  be  rotated  very  slowly.  The  calcula- 
tions for  the  line  acquisition  rate  are  as  follows: 

Time  to  transfer  data  to  tape,  Tj  - 24.1  ms 

Time  for  tape  record  gap,  burst  and  stop  T2  = 24.8  ms 

Minimum  time  per  acquired  line  T3  = T j + T2  = 48.9  ms. 

Since  there  is  about  ±15%  variation  in  the  uniformity  of  time  periods  between  the  0.005- 
inch  pulses  (probably  due  to  stiction)  at  these  low  speeds,  the  nomonal  line  acquisition  rate 
must  be 


T4=^5  =S7'6mS  ' 

Then  the  total  time  per  revolution  for  8192  pulses  is 
8192  _ 7.80  minutes 


t5  = t4x 


60 


revolution 


or 


_1_  _ 0. 1 28  revolution 

T minute 

Since  there  is  bountiful  illumination  from  the  Sylvania  fluorescent  lamps,  it  is  des- 
irable to  minimize  smear  and  provide  uniform  integration  time  by  scanning  the  data  from 
the  Fairchild  CCD1 21  at  its  maximum  specified  rate  of  operation,  one  megapel  per  second. 
Including  overhead  time,  the  readout  rate  is 

D _ 1 readout 
1 1.76  ms 

Then  at  these  speeds,  there  will  be 

N _ 57.6  ms  x 1 readout  _ 32.7  readouts 

• 0.005  in  scan  1.76  ms  0.005  in  scan 

If  the  system  is  programmed  to  accept  the  first  full  scan  line  after  each  0.005-inch  encoder 
pulse,  the  position  accuracy  will  be 

Sj  = 0.005  inches  ± = 0 005  ± 0.0001 5 inches, 

which  is  ±3%. 

The  CCD121  failed  to  operate  properly  when  it  was  first  installed  in  the  test  bed. 
Although  the  device  is  mounted  in  a larger  dual  in-line  package  (DIP)  having  24  pins  on 
100-by  660-mil  centers  rather  than  the  18  pins  which  the  CCD1 10  has  on  100-by- 
300-mil  centers,  the  number  of  signals  required  is  the  same  for  both.  Also,  the  specified 
waveforms  and  amplitudes  are  generally  identical  for  both  devices.  An  adapter  socket  was 
made  to  accommodate  the  CCD  121  with  proper  pin  assignments,  but  initial  operation  was 
quite  poor.  No  values  of  readjusted  biases  or  clock  amplitudes  cleared  the  problem.  Mr  Joe 
Rothstein  of  Fairchild,  Palo  Alto,  was  contacted.  From  our  description  of  the  symptoms 
and  the  fact  that  the  device  is  a new  production  version,  he  predicted  that  the  device  was 
charge  injecting  due  to  clock  swings  having  voltage  excursions  more  negative  than  the  sub- 
strate and  activating  protection  diodes.  We  clamped  the  clocks  with  1N914  diodes  to  pre- 
vent negative  excursions  and  the  scanner  began  to  operate  properly. 

An  attempt  was  made  to  improve  the  video  response  in  the  circuit  by  dc  coupling  the 
video  amplifier  chain.  This  worked  exceedingly  well  unless  the  light  amplitude  around  the 
first  three  or  four  pels  was  modulated.  A variation  in  light  amplitude  at  this  end  of  the  de- 
vice caused  the  dc  level  of  the  entire  device  to  change  markedly.  Dimming  the  light  on  the 
first  three  pels  caused  an  increase  in  the  entire  line  response.  A sensitive,  high-impedance 
scope  was  connected  to  the  video  output  of  the  chip.  No  output  dc  change  was  noted  with 
the  illumination  change.  The  scope  was  moved  to  the  chip’s  compensation  output  and  an 
appreciable  change  in  dc  voltage  was  noted  with  a variation  in  impinging  light. 
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We  again  contacted  Fairchild,  Palo  Alto,  and  talked  to  Mr  Howard  Murphy.  He  men- 
tioned that  the  devices  had  “peripheral  response,”  but  that  this  was  not  the  same  symptom. 
He  said  he  would  try  the  same  test  on  their  setup  and  call  us  back.  He  called  back  the  next 
day  and  said  their  units  did  not  respond  the  same  way.  Both  NELC  units  reacted  identically 
when  tested  here. 

A decision  was  reached  to  revert  to  ac  coupling  with  a gated  clamp.  The  present 
circuit  contains  ac  coupling  into  the  type  733  amplifier  and  on  the  differential  output.  After 
the  second  pair  of  capacitors,  both  signals  are  clamped  between  pel  output  pulses.  The  cir- 
cuit and  the  device  are  now  performing  very  well,  but  neither  we  nor  Fairchild  understand  the 
nature  of  the  light-sensitive  offset  of  the  compensation  amplifier.  When  time  permits,  this 
will  be  investigated.  The  entire  LDTB,  including  the  imaging  path  for  full  8'/2-inch  copy,  is 
now  ready  to  send  data  to  the  frame  store  memory  at  rates  up  to  one  megapel  per  second.  At 
these  speeds  the  response  is  such  that  an  aperture  of  f8.0  is  adequate  with  the  present  light 
source. 


FAIRCHILD  CCD1 10.  The  CCD1 10  (256  pels)  scanner  will  be  used  primarily  for 
purposes  of  demonstration  ot  the  entire  system  as  the  situations  demand.  This  is  the  same 
device  that  was  used  with  the  SDTB. 


RCA  TCI  1 55  CAMERA  IN  TRACKING  MODE.  The  RCA  TC 1 1 5 camera  as  origin- 
ally built  is  a standard  525-line,  closed-circuit  TV  camera  using  the  RCA  SIDS  1 232  surface 
channel  CCD  device.  The  expected  performance  of  the  camera  in  this  configuration  is 
discussed  later  in  this  report.  The  camera  has  been  returned  to  RCA  for  modifications  that 
would  allow  it  to  be  operated  in  limited  image  tracking  mode.  When  the  camera  is  returned 
(with  the  surface  channel  device  still  in  place),  the  camera  will  be  mounted  on  the  LDTB 
for  operating  in  the  tracking  mode.  After  such  time  as  it  takes  to  debug  the  tracking  mode 
operations  and  performance  data  have  been  collected,  the  camera  will  be  returned  to  RCA 
again  for  installation  of  a special  device.  This  device  will  be  loaned  to  the  program  for  a 
period  of  1-2  months;  during  that  time  the  camera  will  again  be  mounted  on  the  LDTB 
and  operated  in  the  tracking  mode  for  comparative  tests  and  data  collection. 


RCA  TCI  155  ALL  SOLID-STATE  CAMERA-AREA  IMAGING 


THEORY  OF  OPERATION 

The  RCA  TCI  1 55  All  Solid-State  Camera  employs  the  use  of  the  SID5 1 232  Area 
Imaging  Device.  The  operation  of  this  device  for  acquiring  two-dimensional  images  is  shown 
in  figure  Cl  6.  The  device  itself  is  a single  silicon  bar  containing  320  vertical  surface  channel 
CCD  arrays  spaced  on  1.2-mil  centers.  The  upper  256  and  the  lower  256  three-phase  clock 
sections  have  separate  clock  control  lines  so  that  data  can  be  manipulated  separately  in  the 
upper  half  and  the  lower  half  or,  if  desired,  can  be  manipulated  in  synchronism  from  one  half 
to  the  other. 

At  the  bottom  of  the  array  there  exists  one  high-speed  horizontal  CCD  surface  channel 
shift  register  which  allows  the  contents  of  the  vertical  shift  registers  to  be  swept  from  the 


256  30  CELLS 
IMAGING  AREA 


256  30  CELLS 
STORAGE  AREA 


FigureC16.  RCATC1155  camera  imaging  system  using  SID5 1232. 


bottom  of  the  array  as  320  pel  signals  are  deposited  onto  the  horizontal  array.  The  output 
rate  of  the  horizontal  register  is  at  least  6.2  megapels  per  second.  The  specified  vertical 
transfer  rate  of  the  vertical  shift  register  is  280  kilopels  per  second. 

In  the  TCI  155  camera,  the  lower  half  of  the  device  is  not  used  for  optical  image 
acquisition.  Alternatively  it  is  used  for  the  temporary  storage  of  the  previous  field  of 
data,  which  is  shifted  slowly  out  to  the  horizontal  shift  register  as  rapidly  as  the  video  can 
be  generated. 

In  operation  the  optical  half  of  the  device  (320-by-256  pels)  remains  unclocked  for 
a period  of  one  Field  time  (approximately  1 6 milliseconds).  At  the  end  of  this  period, 
during  vertical  retrace,  the  clocks  for  the  optical  half  of  the  device  and  the  storage  half  of 
the  device  are  operated  together  rapidly.  This  quickly  shifts  the  electrons  gathered  in  the 
photosites  from  the  optical  half  of  the  device  down  into  the  storage  half.  At  this  time  the 
clock  leads  for  the  upper  (optical)  half  of  the  device  are  again  disconnected  and  integration 
of  photoelectrons  begins  for  the  alternate  field  of  the  frame.  The  clock  leads  for  the  lower 
storage  device  are  slowed  down  to  about  15.75  kilohertz  per  three-phase  cycle.  At  this 
speed,  data  are  fed  into  and  shifted  out  of  the  high-speed  horizontal  shift  register  at  a 
line  and  video  data  rate  which  is  compatible  with  commercial  television. 


DIFFERENCES  FROM  GENERAL  ELECTRIC  AND  FAIRCHILD 

The  operation  of  the  TCI  155  camera  is  different  from  operation  of  GE  and  Fairchild 
cameras  in  some  ways.  The  GE  camera  employs  a charge  injection  device  (CID)  which  does 
not  shift  the  video  information  at  all  in  obtaining  an  optical  image.  Electrical  signals  on 
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electrodes  of  row  and  column  pel  pairs  are  manipulated  to  cause  individual  data  from  indivi- 
dual photosites  to  be  fired  into  the  substrate  at  a spatial  rate  compatible  with  commercial 
television. 

The  Fairchild  area  arrays  do  not  use  the  photosites  themselves  as  the  CCD  shift 
registers.  Fairchild  accumulates  data  in  photosites  and  then  transfers  the  data  alternatively 
from  odd  and  even  field  into  vertical  buried  layer  CCD  channels  which  are  metal  masked  to 
prevent  optical  sensitivity  within  the  CCD  array  itself.  In  this  manner  it  is  not  necessary 
to  provide  a separate  area  of  the  chip  for  storage  since  the  storage  for  each  half  frame  is 
accommodated  within  the  optically  protected  vertical  CCD  channels.  Also,  it  is  not  neces- 
sary to  shift  the  image  information  at  high  speeds  to  the  horizontal  output  shift  register.  A 
rate  of  15.75  kilopels  per  second  is  just  adequate  to  allow  the  device  to  operate  compatibly 
with  conventional  television  line  and  frame  rates.  The  Fairchild  area  device  has  a buried 
layer  horizontal  output  CCD  array.  The  fact  that  all  CCDs  on  the  Fairchild  device  are  in 
buried  layer  technology  greatly  improves  the  charge  transfer  efficiency  and  contrast  dynamic 
range  as  compared  to  an  RCA  surface  channel  device. 


BENCH  TEST  CHARACTERIZATION  OBSERVATIONS 


INTRODUCTION 

The  model  TCI  155  “Solid-State  Imager”  Camera  was  exercised  extensively  with  the 
aid  of  a Gamma  Scientific  Model  125  Microprojector,  Bausch  and  Lomb  High-Intensity 
Grating  Monochromator,  Conrac  9-inch  TV  monitor,  Tektronix  465  scope,  Polaroid  C5 
Close-Up  Camera,  various  photometric  accessories , test  targets,  and  optical  filters.  In  gen- 
eral. the  exercises  were  for  the  purpose  of  gaining  operational  familiarity  and  qualitative 
performance  data.  The  following  paragraphs  describe  various  tests,  results,  and  observa- 
tions about  the  CCD  camera  performance.  The  Polaroid  camera  was  used  to  record  the  CCD 
performance  as  revealed  by  the  TV  monitor  and  corresponding  oscilloscope  waveforms. 
Figure  Cl  7 shows  most  of  the  equipment  used  in  characterizing  the  performance  of  the 
RCA  CCD  camera.  The  camera  without  a lens  is  shown  mounted  on  the  micro-projector. 

RESOLUTION 

The  first  testing  of  the  CCD  camera  involved  the  use  of  the  microprojector  and  var- 
ious high-contrast  test  slides  including  the  Air  Force  Three  Bar  Test  Charts.  Figures  Cl  8a, 
b,  and  c illustrate  the  general  performance  of  the  camera.  The  problem  these  photographs 
illustrate  is  poorer  resolution  and  contrast  in  the  vertical  direction  as  compared  to  the  hori- 
zontal, particularly  in  figures  18b  and  c.  This  characteristic  is  the  result  of  relatively  poor 
transfer  efficiency  in  the  imager.  This  problem  will  be  demonstrated  in  more  detail  with 
other  signals  and  photographs. 

Examination  of  the  TV  monitor  with  the  AF  Test  Chart  in  the  projector  revealed 
ghost  images  in  the  horizontal  plane.  This  problem  did  not  show  up  well  in  the  first  photo- 
graphs so  a different  test  was  used.  A slit  of  light  3-by-100  mils  was  projected  onto  the 
imager  with  a reduction  of  1.8:1.  The  line  was  positioned  vertically  and  horizontally.  The 
results  are  shown  in  figures  Cl 9a  and  b,  respectively.  Figure  19a  clearly  shows  the  ghost 
images  and  figure  20a  shows  the  electrical  signal  causing  the  ghost.  The  reason  for  the 


Figure  Cl 8a.  Air  Force  Three  Bar 
Test  Chart  as  reproduced  by  the 
RC  A CCD  camera  on  a TV  monitor 


Figure  C18b.  Center  portion  of  C 18a 
enlarged  to  better  show  the  difference 
in  horizontal  and  vertical  resolution. 


Figure  C18c.  Lower  left  portion  of 
Cl 8a  enlarged  to  show  variation  in 
resolution. 


Figure  C19a.  CCD  camera  reproduction 
of  a 1 ,7-by-55-mil  slit  of  light  positioned 
vertically.  Note  ghost  images. 


Figure  CI9b.  The  same  slit  of  light 
positioned  horizontally. 


Figure  C21a.  Reproduction  of  a 
0.4-by-l 4-mil  light  slit  positioned 
vertically  and  centered  on  a pel. 
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ringing  is  the  L-C  filters  used  in  the  camera  circuitry  to  filter  out  all  the  clock  noise  of  the 
digital  circuitry.  It  probably  is  not  practical  to  eliminate  the  problem  with  better  filters 
and  still  maintain  single-pel  resolution.  When  the  camera  is  used  for  continuous  tone  images, 
this  would  not  be  a serious  problem,  but  for  reading  high-contrast  printed  material  it  would 
be  serious.  The  solution  for  this  application  is  the  “sample  and  hold”  technique. 

Figure  Cl 9b  shows  again  the  poor  resolution  in  the  vertical  direction,  and  the  comet- 
like tail  below  the  line  is  the  result  of  the  poor  transfer  ratio.  The  limited  dynamic  range  of 
the  photographs  makes  them  a poor  comparison  device,  but  comparing  the  waveform  amp- 
litudes in  figures  C20  a and  b reveals  a difference  of  more  than  2: 1 even  though  the  light  in- 
tensity was  maintained  constant. 

The  1.8: 1 reduction  of  the  3-by-100-mil  light  slit  gives  a light  slit  at  the  CCD  imager 
of  1.67  mils,  which  is  almost  1.4  pelsfeach  pel  is  1.2-by-1.2  mils).  The  light  slit  reduction 
ratio  was  reduced  to  7.2: 1 to  give  a light  slit  at  the  imager  of  about  0.4  mil  or  0.35  pel. 
Figures  21a,  b,  c,  and  d show  the  results  of  this  test.  As  before,  the  light  amplitude  was  held 
constant.  The  most  interesting  point  about  this  test  is  seen  by  comparing  the  pulse  width 
in  photographs  20a  and  22a-the  difference  is  very  minimal.  Figures  21  d and  22d  show  the 
results  of  positioning  the  light  slit  directly  over  the  junction  of  adjacent  pels.  Again,  the 
resulting  pulse  width  is  not  much  different.  The  conclusion  to  be  drawn  from  this  is  that 
the  L-C  filters  used  to  smooth  out  the  video  signal  are  not  necessarily  the  best  choice  for 
single-pel  resolution. 
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Figuii*C21b.  Light  slit  positioned 
at  45  degrees. 


Figure  C2  Ic.  Light  slit  positioned 
horizontally. 


Figure  C2ld.  Light  slit  positioned 
over  the  junction  of  adjacent  pels. 


Figure  C22b.  Video  signal  for  C2  lb 


Figure  C22c.  Video  signal  for  C2  1 e 


Figure  C22d.  Video  signal  for  C2  Id 
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BLEMISHES 

All  test  signals  were  removed  and  the  TV  monitor  brightness  and  contrast  controls 
were  adjusted  to  look  for  imager  blemishes.  Figure  C23  shows  the  results.  None  of  the 
blemish  areas  appears  to  be  completely  dead  just  less  sensitive  than  adjacent  areas.  Even 
the  solid  dark  vertical  line  yields  light.  No  oscilloscope  pictures  were  taken  showing  the 
blemishes  because  it  was  virtually  impossible  to  isolate  them  for  photographic  record. 


Figure  23.  Blemishes  on  the  CCD  imager  as  seen  on  a TV 
monitor  with  no  other  signal  present  and  the  monitor 
brightness  set  higher  than  normal. 


COLOR  SENSITIVITY 


Some  interference  filters  were  put  into  the  microprojector  to  simulate  red,  green,  or 
blue  radiation  that  may  be  required  to  maximize  the  contrast  between  various  inks  and  papers. 
With  no  test  target  in  the  projector,  the  TV  monitor  brightness  was  noted  to  be  quite  uneven, 
and  this  unevenness  changed  with  the  color  of  radiation  that  was  flooding  the  CCD  imager. 

In  order  to  further  check  out  this  characteristic,  a Bausch  and  Lomb  High-Intensity  Grating 
Monochromator  was  used  to  flood  the  imager  with  essentially  flat  illumination.  The  slits  in 
the  monochromator  were  set  to  give  a half-power  bandwidth  of  about  20  nm.  Figures  C24, 
C25,  and  C26  show  the  TV  monitor  results  and  the  associated  video  waveforms  for  red, 
green,  and  blue  light,  respectively.  The  “b”  photographs  are  of  all  the  video  between  vertical 
sync  marks,  and  the  shape  is  representative  of  the  camera  sensitivity  change  from  top  to  bot- 
tom of  the  imager.  The  thickness  of  the  line  is  representative  of  the  variation  in  sensitivity 
going  across  the  screen.  The  “c”  photographs  show  the  horizontal  variation  near  the  middle 
of  the  picture. 


Figure  C24a.  RCA  CCD  camera 
response  to  630-nm  red  illumination 


Figure  C24b.  Video  signal  between 
vertical  sync  pulses  that  produces 
the  image  in  C24a. 


Figure  C24c.  Video  signal  for  one 
horizontal  line  near  center  of  C24a 
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Figure  C25a.  RCA  CCD  camera 
response  to  530-nm  green  illumination 


Figure  C25b.  Video  signal  between 
vertical  sync  pulses  that  produces 
the  image  in  C25a. 


Figure  C25c.  Video  signal  for  one 
horizontal  line  near  center  of  C25a. 


Figure  C26a.  RCA  CCD  camera 
response  to  430-nm  blue  illumination. 


Figure  C26b.  Video  signal  between 
vertical  sync  pulses  that  produces 
the  image  in  C26a. 


Figure  C26c.  Video  signal  for  one 
horizontal  line  near  center  of  C26a. 


RELATIVE  OUTPUT  VIDEO  SIGNAL 


IMAGER  BIASING 


The  RCA  camera  has  two  red  light-emitting  diodes  (LEDs)  positioned  on  each  side  of 
the  imager  active  area.  These  LEDs  optically  bias  the  imager  (with  “fat  zero”)  to  a level  that 
results  in  satisfactory  performance.  No  attempt  was  made  to  prove  that  RCA  had  made  the 
optimum  adjustment,  but  considerable  effort  was  expended  in  characterizing  the  camera 
performance  with  and  without  the  biasing. 

Figure  C27  shows  the  compiled  results  of  the  testing.  The  absolute  value  of  maximum 
light  input  was  not  measured  but  was  the  same  for  all  four  curves  shown.  Curve  1 appears 
to  be  the  best.  It  was  taken  without  any  bias  illumination,  but  it  is  of  no  use  because  it  was 
the  result  of  flooding  the  entire  chip  with  white  light.  In  effect,  it  shows  the  response  of  the 
chip  to  a bias  that  takes  the  chip  from  zero  output  to  saturation.  Within  the  accuracy  of  the 
measurement  techniques,  the  device  is  linear.  (Linear  response  plots  as  a straight  line  on  log- 
log  paper.) 


Figure  C27.  RCA  silicon  imaging  device  camera,  video  output  as  a function  of  white  light  input. 
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Curves  2,  3,  and  4 are  the  more  practical  ones,  as  they  show  the  performance  when 
a small  area  of  the  imager  receives  illumination  with  different  amounts  of  LED  bias  present. 
Perhaps  the  most  significant  point  these  three  curves  show  is  that  a small  area  saturates  at 
a lower  video  output  level  than  a larger  area  does.  This  is  attributed  to  adjacent  pel  loading 
effects.  Conversely,  it  is  also  noted  in  testing  the  imager  that  a small  dark  area  in  a large 
bright  background  will  not  yield  as  large  a dip  in  the  output  video  level  as  a larger  dark  area 
would.  Taking  the  curves  individually,  the  performance  represented  by  curve  4 (no  back- 
ground bias  was  used)  is  of  no  use.  The  imager  has  no  dynamic  range.  The  performance 
represented  by  curve  3 (about  1 /3  normal  bias  used)  appears  to  have  acceptable  dynamic 
range.  However,  it  saturates  with  a more  pronounced  characteristic  than  when  full  bias 
(as  determined  by  RCA)  is  used,  as  represented  by  curve  2.  Although  it  was  possible  to 
increase  the  bias  above  the  normal  setting,  it  could  not  be  raised  enough  to  make  another 
curve.  It  does  appear,  however,  that  the  bias  level  chosen  by  RCA  is  near  optimum  for 
most  purposes. 

In  addition  to  the  data  presented  in  figure  C27,  there  is  another  reason  why  perform- 
ance of  the  imager  is  not  acceptable  when  the  background  bias  is  reduced  significantly  or 
eliminated  completely.  This  reason  is  shown  rather  dramatically  in  figures  C28a  through  C28h. 
Figure  C28  shows  how  the  TV  monitor  image  is  affected  by  decreasing  the  background  bias 
while  the  test  pattern  brightness  is  held  constant.  Figure  C29  shows  one  horizontal  line  of 
video  at  the  center  of  the  test  spot.  They  are  included  to  show  graphically  where  the  back- 
ground bias  was  set  for  the  respective  TV  image  and  unevenness  of  the  bright  spot  in  figure 
C28  is  not  the  fault  of  the  imager.  The  bright  spot  is  produced  by  a fiber  optic  cable  which 
has  a few  broken  fibers.  However,  most  of  the  unevenness  results  from  the  ends  of  the  fib- 
ers not  all  being  cut  exactly  square. 


GENERAL  VIEWING 

The  TCI  1 5 camera  was  also  tested  for  general  viewing.  A short  video  tape  report 
was  made  for  the  sponsor  using  the  camera  with  ordinary  room  illumination.  The  camera  was 
judged  to  be  acceptable  for  entertainment  quality  TV.  It,  of  course,  does  not  have  as  much 
resolution  as  a good  vidicon  camera  but  has  better  resolution  than  any  other  solid-state  camera. 
It  appears  to  have  less  dynamic  range  than  the  GE  charge  injection  cmera. 

As  a camera  the  equipment  is  not  applicable  for  USPS  document  imaging.  A multi- 
plicity of  abutted  S1D51232  imaging  devices  would  be  useful  for  document  scanning  in  the 
tracking  mode,  as  was  discussed  in  last  year’s  annual  program  report.  The  new  imaging  de- 
vice, now  under  development  at  RCA,  Princeton,  will  be  much  superior. 
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Figure  C28a.  RCACCD  camera 
response  to  a bright  spot  on  a dark 
background  at  full  background 
bias.  Figures  b through  e are  for 
reduced  levels  of  bias  illumination. 
Figures  f through  h show  camera 
response  to  a dark  spot  on  a bright 
background  with  decreasing  levels 
of  background  bias. 


Figure  C28f.  Full  background 
bias  illuminztion. 


Figure  C28g 


Figure  C29a.  Figures  C29a  through 
h show  a horizontal  line  of  video 
at  the  center  of  the  images  for 
figures  C28a  through  h,  respectively. 


Figure  C29b. 


Figure  C29c. 
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TRACKING  IMAGER  TESTS 


INTRODUCTION 

The  Advanced  Mail  Systems  Scanner  Technology  First  Annual  Report  discusses  the 
advantages  of  a “tracking”  imager  both  in  increased  resolution  in  the  direction  of  copy  mo- 
tion and  in  optical  sensitivity.  Also  included  in  the  report  were  recommendations  to  pursue 
investigations  into  abutting  two  or  more  of  the  RCA  SID5  1 232  devices  to  obtain  a wider 
image  than  the  320  pels  available  from  a single  imager. 

Doctors  Walt  Kosonocky  and  Jim  Carnes  of  RCA.  Princeton,  felt  that  it  is  possible 
to  design  and  fabricate  a single  device  which  will  meet  all  the  present  Postal  Service  require- 
ments. These  requirements  include: 

1 . At  least  1700  (and  preferably  an  option  of  2200)  pel  resolution  normal  to 
the  direction  of  copy  motion. 

2.  An  output  rate  of  84  megapels  per  second  preferably  from  at  least  four  ports, 
with  each  concurrent  output  providing  data  on  four  or  more  adjacent  pels. 

3.  Operation  in  the  tracking  mode  to  improve  resolution  and  optical  sensitivity. 

RCA  has  submitted  an  unsolicited  proposal  to  NELC  (p75-l  15,  RCA  Princeton,  12 
December  1975)  to  design,  fabricate,  test,  and  deliver  working  samples  of  devices  which 
will  verify  the  level  of  achievement  of  the  above  goals.  NELC  has  accepted  the  proposal, 
and  a contract  (N001 23-76-C-0980,  15  March  1976)  has  been  awarded.  RCA  will  design 
and  fabricate  a number  of  prototype  devices  having  at  least  750  elements  in  the  horizontal 
direction  (normal  to  copy  motion)  and  up  to  100  elements  in  the  vertical  (tracking)  direc- 
tion. These  will  be  completely  characterized  by  the  RCA  staff.  At  the  termination  of  the 
tests,  the  data,  any  support  electronics,  and  10  of  the  devices  will  be  delivered  to  NELC 
(about  15  March  1977)  for  further  studies  on  the  program. 


THEORY  OF  OPERATION 

The  theory  pertaining  to  tracking  imager  advantages  was  covered  in  last  year’s 
annual  report,  but  will  be  repeated  here  because  of  its  relevance  to  the  best  approach  we 
have  devised  to  achieving  the  USPS  imaging  goals. 

A device  such  as  the  RCA  SID  5 1 232  can  be  controlled  while  accumulating  photon- 
generated electron  charge  packets  of  data  to  transport  the  potential  wells  in  synchronism 
with  the  projected  moving  image  impinging  on  the  array.  In  addition  to  the  advantage  of 
a longer  integration  time  and  the  lack  of  a requirement  for  concentrated  illumination,  the 
resolution  which  can  be  obtained  in  the  direction  of  copy  motion  is  substantially  improved. 
The  achievable  improvement  in  resolution  which  can  be  made  by  using  a tracking  imager 
can  be  seen  in  Figure  C30.  On  the  left  side  of  the  figure  a standard  line  imager  such  as  the 
Fairchild  CCD1  10  is  presented.  On  the  right  side  a tracking  imager  having  a three-phase 
clock  such  as  the  RCA  SID5 1 232  device  is  presented.  The  figure  shows  (from  top  to 
bottom)  the  acquisition  cycle  for  two  cells  of  data  from  each  of  the  two  types  of  imagers. 

A cell  in  this  case  is  meant  to  be  one  complete  line  of  data  shifted  from  the  CCD  device 
in  the  case  of  the  line  imager.  In  the  case  of  the  tracking  imager,  one  cell  is  meant  to  be 
one  family  of  three  phases  of  image  data  being  transported  in  the  direction  of  the  impinging 
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image  along  the  device.  The  sequence  of  small  pictorial  diagrams  from  top  to  bottom  on 
the  left  hand  side  of  the  page  depicts  the  motion  of  copy  during  each  one-third  of  a line 
sample  interval.  In  the  next  column  to  the  right  of  these  sketches  the  accumulation  of 
charge  within  the  cell  is  diagrammed.  These  increasing  charge  diagrams  verify  the  process 
of  the  convolution  integral  of  the  imager  with  a rectangular  aperture  and  an  equivalent  area 
of  projected  information  from  the  copy  below. 

The  accrued  charge  in  cell  one  at  time  t = tj  is  the  familiar  triangle  resulting  from 
convolution  of  two  rectangular  areas.  It  can  be  seen  that  the  contributions  to  the  charge 
under  the  triangle  have  come  from  image  points  ranging  from  A through  M on  the  copy, 
with  the  maximum  point  occurring  at  image  point  G.  This  is  because  point  G was  the  only 
point  to  contribute  continuously  to  the  illumination  of  the  cell  throughout  the  entire  period 
from  tg  to  tj.  Location  A on  the  copy  moved  from  the  field  of  view  of  cell  one  immediately 
after  the  cell  was  dumped  from  the  previous  scan,  and  point  M moved  into  the  field  of  view 
just  as  cell  one  was  dumped. 

What  is  depicted  at  cell  two  is,  of  course,  the  same  imager  being  photoactivated 
again  during  the  interval  between  tj  and  t2  after  being  dumped  at  t j . The  same  familiar 
triangular  waveform  from  the  convolution  is  present,  with  the  point  M on  the  copy  being 
at  the  highest  point  during  this  scan  period.  At  the  bottom  of  the  figure  the  true  apertures 
of  cell  one  and  cell  two  are  plotted  to  show  the  overlap  which  exists  between  cell  one  and 


cell  two  (the  cross-hatched  area).  That  portion  of  the  cell-one  area  which  lies  in  sample 
space  two  (which  is  1 2/2%  of  the  area  under  the  cell-one  curve)  actually  lies  in  sample  space 
two.  Another  1 2yh%  of  the  cell-one  area  actually  lies  in  sample  space  zero.  Therefore,  25% 
ot  the  cell-one  output  has  no  relationship  to  the  information  within  sample  space  one  at 
all,  but  rather  is  an  erroneous  reading  of  information  actually  acquired  in  sample  space  zero 
and  sample  space  two.  One  method  of  preventing  this  overlap  is  to  double  the  line  scan 
frequency,  which  in  turn  oversamples  the  information  normal  to  the  direction  of  copy  mo- 
tion by  a factor  of  2: 1 . This  also  doubles  the  CCD  output  rate  requirement,  which  is  already 
a formidable  83  megapels  per  second. 

A similar  pair  of  sequential  drawings  is  shown  on  the  right  side  of  the  page  for  the 
tracking  imager.  The  tracking  imager  has  the  ability  to  move  the  location  of  the  accumu- 
lating photo  sites  and  potential  wells  to  the  right  in  this  picture  in  three  discrete  steps  per 
sample  time  interval  in  synchronism  with  the  motion  of  the  copy  image  on  the  device. 
Integration  starts  with  the  copy  and  cell  as  shown  in  the  top  figure.  As  the  copy  moves  to 
the  left,  image  point  C on  the  copy  projects  an  image  which  passes  to  the  right  and  out  of 
the  view  of  cell  one.  Therefore,  no  contribution  from  image  point  C is  contained  in  cell 
one.  Information  from  point  D.  however,  and  point  E projects  progressively  longer  onto 
cell  one  before  the  copy  has  moved  far  enough  that  the  image  is  beyond  the  view  of  cell 
one.  Therefore,  the  accumulated  image  data  in  cell  one  at  tg  + At/3  is  the  same  for  the 
tracking  imager  as  it  was  for  the  line  imager.  At  this  point  the  operation  of  the  tracking 
imager  diverges  from  that  of  the  line  imager.  At  tg  + At/3,  the  clock  phases  of  the  poten- 
tial well  of  cell  one  are  changed  so  that  the  cell  moves  by  an  increment  of  one-third  line 
scan  interval.  By  design,  this  is  exactly  the  same  distance  that  the  projected  image  of  the 
copy  had  moved  during  the  first  interval.  Therefore,  during  the  time  between  tg  + At/3 
and  tg  + 2 At/3,  the  same  optical  relationship  remains  which  existed  during  the  first  one- 
third  interval,  and  the  acquired  image  data  will  relate  to  exactly  the  same  points  on  the  copy 
as  during  the  first  interval.  Consequently,  the  convolution  waveform  appears  to  be  exactly 
like  the  one  above  it  except  that  it  now  has  twice  the  amplitude. 

At  just  after  time  tg  + 2 At/3  the  potential  wells  of  the  tracking  imager  device  are 
again  shifted  by  one-third  sample  space  and  the  image  is  caused  to  sweep  over  the  same 
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one-third  increment  for  the  third  time,  providing  a final  convolution  waveform  which  ap- 
pears three  times  the  amplitude  of  the  first  increment. 

After  cell  one  has  been  dumped  or  carried  forward  for  further  integration  into  a 
final  output  shift  register,  a second  cell  immediately  following  the  first  begins  to  acquire 
data  on  subsequent  points  on  the  copy  space.  The  buildup  of  photosensitive  charges  is 
shown  for  cell  two  immediately  below  cell  one. 

Again  at  the  bottom  of  the  figure,  cell-one  and  cell-two  waveforms  are  shown  side 
by  side,  again  indicating  the  overlap  between  the  two  cells.  This  time  the  overlap  is  dra- 
matically reduced  by  a factor  of  3: 1 so  that  the  total  contribution  is  only  approximately 
4%  from  sample  space  two  into  cell  one;  and  second,  the  contribution  that  is  made  does 
not  deeply  penetrate  into  cell  two  but  extends  only  one-sixth  of  the  way  past  the  boundary 
between  cell  one  and  cell  two.  No  degradation  in  response  will  occur  in  either  type  of 
operation,  since  the  total  areas  of  charge  one  under  the  line  imager  and  the  tracking  imager 
are  identical. 

This  apparent  great  improvement  in  resolution  in  the  directiofi  of  copy  constitutes 
a deblurring  advantage  only  if  the  tracking  imager  can  be  made  to  follow  exactly  the  pro- 
jected image  of  the  copy  on  the  imager  photosensitive  area.  The  sample  spaces  shown  at 
the  bottom  of  the  page  represent  physical  dimensions  on  the  copy  of  only  0.005  inch  each. 
The  distance  between  the  letters  I and  J in  sample  space  one  represents  only  0.00083 
inch.  If  the  tracking  imager  cannot  be  controlled  to  follow  the  copy  image  to  approxi- 
mately this  accuracy,  the  only  remaining  advantages  of  broader  illumination  latitude  and 
longer  integration  time  will  have  to  be  examined  to  determine  the  cost-effectiveness  of 
exploiting  a tracking  imager. 


NEAR-TERM  TEST  PLANS 

Both  the  government  and  RCA,  Princeton,  are  anxious  to  evaluate  the  concept  of 
tracking  imaging  as  applied  to  Postal  image  acquisition.  RCA  (and  others  in  CCD  develop- 
ment work)  refer  to  this  technique  as  the  time-delay-integration  (TD1)  mode.  One  of  the 
important  near-term  goals  of  the  program  is  to  run  meaningful  tests  with  available  equip- 
ment which  will  assist  in  the  design  decisions  of  the  devices  now  under  contract  to  RCA. 


CAMERA  MODIFICATIONS 

There  are  a number  of  modifications  required  in  the  RCA  TCI  155  camera  for  oper- 
ation in  the  tracking  (TDI)  mode.  A decision  has  been  reached  to  utilize  the  internal 
15.75-kHz  clock  signal  as  the  three-phase  tracking  mode  clock  frequency.  The  alternatives 
were  to  change  the  internal  oscillator  frequency  to  48.0  kHz  to  match  our  maximum  de- 
sign goal  acquisition  rates  or  to  provide  for  external  input  of  a variable  or  drum  controlled 
clock.  A terminal  which  will  provide  the  15.75-kHz  output  signal  will  be  added  to  the 
camera.  It  is  also  necessary  to  modify  some  of  the  gate  control  signals  into  or  out  of  the 
SI  DA  1002  analog  switch  IC  so  that  the  15.75-kHz  clock  signals  are  provided  to  the  “4>B” 
lines  continuously  during  tracking  operations. 

A physical  disassembly  of  the  camera  is  necessary  in  order  to  illuminate  the  half 
i the  SID5  1 232  imager  device  normally  used  for  storage.  The  front  face  containing  the 
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lens  mount  will  be  carefully  removed  and  an  alternate  lens  holder  will  be  substituted.  It 
would  be  possible  to  use  the  regular  imaging  area  of  the  SID5 1 232  if  the  “<t>A”  three-phase 
clock  leads  were  also  switched  to  the  15.75-kHz  continuous  signal,  but  if  this  were  done  the 
tracked  signals  would  be  required  to  pass  through  the  additional  256  storage  stages  of  the 
vertical  CCDs  in  order  to  reach  the  output  horizontal  register.  Better  signal  quality  should 
be  obtained  by  using  the  stages  immediately  adjacent  to  the  output  horizontal  register  for 
the  optical  imaging. 

Some  additional  modifications  are  being  made  to  the  camera  in  order  to  evaluate 
some  proprietary  RCA  devices  in  the  tracking  mode.  These  are  described  in  the  proprietary 
appendix  (TR  2020  v 2,  available  to  US  Government  agencies  only). 

TEST  SETUP 

The  ideal  test  setup  for  tracking  imager  studies  would  include  a facility  for  care- 
fully controlled  linear  motion  of  flat  pages  of  test  copy.  Neither  of  the  NELC  test  beds 
can  accommodate  this  feature,  although  some  thoughts  have  been  given  to  providing  a 
“belt”  of  70-mm  photographic  film  copy  for  the  SDTB  which  could  be  mounted  in  con- 
junction with  an  idler  pulley  to  provide  a limited  flat  bed  capability.  By  back  lighting  the 
film  through  an  opal  glass  suspension  shoe  (like  a belt  sander)  and  obtaining  synchronizing 
impulses  from  the  sprocket  holes  which  can  be  ratio  matched  on  a dual-beam  scope  with 
the  15.75-kHz  pulses,  a somewhat  ma'rginal  setup  can  be  obtained. 

The  problems  of  tracking  copy  mounted  on  a curved  drum  surface  are  related  to 
► the  geometric  distortions  of  the  X and  Y apparent  motions  of  portions  of  the  image  as 

seen  from  the  lens  position.  These  distortions  decrease  as  a function  of  increased  drum 
diameter  and  increase  as  a function  of  height  of  image  space  used  in  the  optical  acquisition 
process  in  the  direction  of  copy  motion. 

Appendix  D (to  this  appendix)  shows  the  equations  related  to  the  aberrations 
generated  by  the  curved  object  surface.  It  also  shows  by  the  three  examples  that  by  using 
100  pels  or  less  in  the  direction  of  copy  motion,  the  errors  in  vertical  and  horizontal  non- 
linearity are  not  greater  than  40%  of  a pel  area.  Example  3 in  this  appendix  also  indicates 
that  even  the  SDTB  can  be  used  to  obtain  meaningful  measurements  with  the  TCI  155 
Camera  in  the  tracking  mode.  It  should  be  pointed  out  that  the  errors  are  a function  of  the 
location  of  the  optically  unmasked  and  illuminated  area,  so  that  verification  of  the  calcu- 
lated aberrations  and  their  cosmetic  effects  on  acquired  images  can  be  studied  for  a variety 
of  numbers  of  pels  used  in  the  direction  of  tracking. 


SOLID-STATE  IMAGER  STATUS 

At  the  end  of  last  year’s  program,  a table  (table  C2)  was  provided  in  the  annual  re- 
port. It  included  all  known  off-the-shelf  solid-state  imaging  devices  which  could  be  rele- 
vant to  USPS  imaging  applications.  This  table  is  being  included  unmodified  in  this  report. 
Only  two  new  devices  of  any  significance  have  been  developed  this  year,  and  data  sheets 
have  not  been  made  available  on  these  as  yet.  One  device  is  a 1728-bit  line  imager  from 
Reticon.  The  other  is  a Fairchild  area  imager  having  380  and  488  pels  in  width  and  height, 
respectively. 

Neither  of  these  imagers  would  change  the  ranking  of  choices  on  table  C2.  The  time- 
delay  integration  imager  now  under  contract  at  RCA,  Princeton,  of  course,  now  outranks  all 
other  candidates  on  the  table,  since  it  will  be  designed  specifically  for  high-speed  tracking 
of  USPS  copy  material 


Area  Devices  fj  Linear  Devices 


TABLE  C2.  RELATIVE  APPLICABILITY  OF  VIDEO  SENSORS  FOR  ] 


Manufacturer 

Reticon 

Reticon 

Reticon 

Fairchild 

Fairchild 

Fairchild 

AMERCON 

Reticon 

Fairchild 

RCA 

RCA 

RCA 

GE 


Device 

Type 

Number 


RL-SI2B  | 512X1 


Element 

Spacing 

mils 


Element 

Size, 

mils  X mils 


Data  Rate 


min  I max 
kKz  I MHz 


Sensitivity 

fc*s 


1.0X  1.0  10  40  7 X 1 0"H 

3.5  X 10"2 


Saturation 

Exposure 

fc-s 


7 X 10'2 
3.5 


RL-1024B  I 1024X  1 1.0  1.0  X 1.0  10  40  7X10"4 


3.5  X 10"- 


RL-I872F  I 1872X1 


CCD-101  1*  500X1 


0.59X  0.63  1 10  I 20  1 1 3 pa/ft  cdl 


1.0X  1.0  10 


0.26  pa/pW/cm- 

3.0  X 10"5 
1.5  X 10"3 


15  X 10" 
0.75 


CCD-110  256X1 


0.51  0.51X  0.63  10  10  9.0  X 10"5 

4.5  X 10"3 


9 X 10" 
0.45 


CCD-121  I 1728  X1 


0.51  X 0.67 


5.9  X 10"5 

2.9  X 10"3 


proposed  I 1728  X 1 


PA  50  X 50A  I 50  X 50  4.0  X 4.0 


250  pa/ft  cdl 
5 pa/pW/cm2 


3 X 10"J 
0.15 


CCD-201  I 100X100  I 1 ,2V  X 1 .6 1 1 1 1.2  X 0.8 


1.6  X 10" 
0.8  X 10" 


3.1  X 10"3 
0.16 


SID  5 1232  I 512  X 320  1.2  X 1.2  I 1.2  X 1.2  10  I 6.1  I 2.9X10"5  2.67  X10"3 


1.4  X10"-5  0.13 


2W  RBV  I 3000  X 3000  I 0.3 


0.3  X 0.3  I 0 I 85 


4"  RBV  I 6000  X 6000  | 0.3 


0.3  X 0.3  I 0 I 85 


10"4 

5 X 10"3 


Z 7892  I 188  X 244  I 1.4  X 2.4  I 1.4  X 2.4  I 10 


1 .1  pa/ft  cdl 
60  ma/W/cm' 


.45 

8 - 8.5 


U*PLIC  ABILITY  OF  VIDEO  SENSORS  FOR  ELECTRONIC  MESSAGE  SERVICE. 


Sensitivity 

fc*s 

jiWs 

Saturation 

Exposure 

fc*s 

pWs 

Uniformity 

of 

Sensitivity 

% 

Dynamic 

Range 

Spectral 

Response 

nm 

Output 

Amplitude 

volts,  max 

Abutment 

Problem 

Remarks 

Relative 

Applicability 

Rank 

cm 

2 

cm 

min 

type 

max 

7 X 1CT4 
3.5  X IO"2 

7 X 10"2 
3.5 

±7 

100 

400  - 1 100 

0.04 

moderate 
3 linear 
abutments 

output  available  from  four 
parallel  video  lines 

5 

7 X IO"2 
3.5 

±7 

100 

400  - 1100 

0.04 

minimum 
1 linear 
abutment 

output  available  from  four 
parallel  video  lines 

4 

pa/ft  cdl 
6 pa/pW/cm2 

0.246 

12.3 

±12 

100 

400-1100 
(900  peak) 

0.06 

none 

output  available  from  four 
parallel  video  lines 

3 

3.0  X 10"5 
1.5  X 10'3 

15  X IO"3 
0.75 

t ±15 

200 

500 

500  - 1000 

0.5 

moderate 
3 linear 
abutments 

speed  limits  applicability 
would  require  80  devices 

— 

SI 

9 X IO"3 
0.45 

±10 

200 

400 

400-  1100 

0.05 

difficult 
7 linear 
abutments 

waveforms  of  output  vs 
noise  are  excellent 

2 

SI 

IO"2 

0.5 

±10 

170 

450  - 1050 

0.2 

none 

speed  limits  applicability  - 
need  80  megapels/s 

- 

? 

7 

requires 

calibration 

adjustment 

100 

350  - 800 

0.5 

none 

cadmium  sulphide  photo- 
resistor  array;  much 
development  required 

iO  pa/ft  cdl 
pa/pW/cm2 

3 X IO"3 
0.15 

±10 

100 

400-  1100 

0.032 

massive 
44  X 34  xy 
abutments 

requires  physical  abutments 
plus  multiple  strobe  expo- 
sures per  page 

.6  X 10~5 
L8  X IO"3 

3.1  X 10"3 
0.16 

±15 

100 

200 

480-  1100 

0.075 

massive 
22  X 1 7 xy 
abutments 

requires  physical  abutments 
plus  multiple  strobe  expo- 
sures per  page 

in  m 
i i 

o o 
X X 

ON  Tt 

2.67  X 10'3 
0.13 

±10 

est 

80 

100 

420  - 1 100 

0.0125 

difficult 
6-*l3 
linear  0 
abutments 

optimum  for  lighting  require- 
ments; requires  tracking  of 
image  with  CCDs 

i 

(highest) 

IO-4 

5 X 10'3 

±10 

est 

100 

450-  1100 

current 

mode 

operation 

none 

has  resolution,  speed  & sen- 
sitivity; the  0.5-s  target  prep 
time  bad 

IO"4 

IX  IO"3 

10"2 

0.5 

±10 

est 

100 

peaks  in 
visible  with 
ASDS 
target 

current 

mode 

operation 

none 

has  resolution,  speed  & sen- 
sitivity; the  0.5-s  target  prep 
time  bad 

jia/ft  cdl  ^ 
Bia/W/cni- 

— 

.45 

8-8.5 

±10 

est 

200 

400-1100 

0.5  from 
preamp 

severe 
9 X 9 xy 
abutments 

requires  physical  abutments 
plus  multiple  strobe  expo- 
sures per  page 

FLYING  WOT  SCANNERS 


INTRODUCTION 

Although  most  of  the  effort  on  the  program  thus  far  has  been  applied  to  solid- 
state  imagers,  some  investigations  were  made  into  the  applicability  of  flying  spot  scanners. 
Data  obtained  from  current  literature  and  trips  to  Dest  Data  and  RCA  confirmed  that 
flying  spot  scanners  are  applicable  to  high-speed,  high-resolution  imaging.  At  the  invitation 
of  the  Electro-Optical  Group  a visit  was  made  to  Harris  Laboratories  in  Melbourne,  Florida. 


HARRIS  ELECTRO-OPTICAL  CAPABILITIES 

At  Harris  we  were  given  a presentation  of  the  various  methods  of  utilizing  flying 
spot  scanners  for  image  acquisition  and  image  recording.  The  speed  and  resolution  limita- 
tions to  each  were  explained.  The  system  applicable  to  USPS  high-speed  image  acquisition 
employed  a Bragg  cell  device  having  a basic  resolution  of  about  1 000  lines  per  sweep. 

This  provided  the  basic  scan  deflection.  An  acousto-optic  traveling  wave  lens  would  be 
used  in  conjunction  with  a cylindrical  lens  to  further  refine  the  spot  size  by  a factor  of  20 
times  or  more  to  an  upper  limit  of  20  000  to  50  000  resolvable  points  per  sweep.  A demon- 
stration of  the  beam  deflection  system  including  the  traveling  lens  indicated  an  extremely 
stable  mode  of  operation.  Mechanical  vibrations  were  compensated  out  by  action  of  the 
traveling  lens.  The  optical  path  required  would  be  about  2 metres  and  can  be  folded  into 
a fairly  compact  assembly. 

From  the  demonstrations  we  witnessed  and  data  we  were  given,  it  is  evident  that 
flying  spot  scanner  technology  is  a candidate  approach  for  USPS  imaging.  More  data  re- 
garding relative  costs,  support  electronics,  and  mechanical  rigidity  will  be  needed  to  pro- 
vide comparative  system  advantages. 


SUMMARY  AND  CONCLUSIONS 

1 . Circuit  design  has  been  completed  which  will  compensate  for  image  brightness 
irregularities  caused  by  nonuniformity  of  illumination,  optical  path,  and  device  response. 

2.  The  RCA  solid-state  camera  has  been  characterized  for  static  imaging. 

3.  Limited  tracking  mode  tests  can  be  made  with  the  RCA  camera  on  the  large 
drum  scanner  test  bed. 

4.  Early  tests  of  the  RCA  camera  in  the  tracking  mode  will  assist  in  the  estab- 
lishment of  parameters  of  the  new  RCA  imager. 

5.  If  successful,  the  RCA  device  development  will  establish  the  technology  and 
architectural  design  of  a single  imaging  device  which  will  meet  all  the  US  Postal  Service 
imaging  goals. 

6.  The  large  drum  scanner  test  bed  now  provides  a facility  with  which  precise,  re- 
peatable imaging  measurements  can  be  obtained. 
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7.  The  large  drum  scanner  test  bed  is  now  interfaced  with  the  frame  store  memory 
controller  and  the  image  analyzer,  which  are  in  turn  interfaced  to  the  Kennedy  tape  deck 
and  the  Tektronix  keyboard  terminal. 

8.  Flying  spot  scanner  technology  appears  to  have  applicability  to  USPS  imaging. 

FUTURE  NELC  PLANS 

1 . Evaluate  the  necessity  for  (or  degree  of)  image  brightness  compensation  by 
software  program  in  the  memory  controller. 

2.  Acquire  a fully  compensated  8'/2-by-l  1-inch  image  having  200-by-200-pel 
resolution  and  full  6-bit  Gray  scale  on  tape. 

3.  Provide  a program  using  the  Kennedy  tape  deck  (and  the  GFE  Bright  tape 
deck)  to  subdivide  the  acquired  image  into  sub-pictures  which  can  be  stored  in  the  frame 
store  memory  and  displayed  on  the  Conrac  monitor. 

4.  Using  the  test  bed,  take  the  data  for  the  image  compressibility  study.  Reduce 
the  data  and  generate  the  summary  report. 

5.  As  schedule  permit",  instrument  the  RCA  camera  and  the  large  drum  test  bed 
to  perform  limited  image  tracking  experiments. 

6.  Convey  the  resulting  information  to  RCA,  Princeton,  and  discuss  applicability 
of  findings  to  the  new  image  design. 


7.  Following  these  milestones,  begin  the  image  enhancement  studies  using  the 
test  bed  and  software  algorithms. 
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APPENDIX  A (TO  TR  2020  APPENDIX  C); 
ILLUMINATION  UNIFORMITY  TEST  DATA 


FULL  SCALE  WIDTH 


Position 
Across  Drum, 
Inches 

Relative  In- 
tensity Output, 
Millivolts 

Repeated 

Readings, 

Millivolts 

Average, 

Millivolts 

Normalized 

Values 

2.0 

86.0 

86.0 

mmm 

2.5 

98.2 

98.2 

im 

3.0 

1 14.6 

114.6 

0.75 

3.5 

128.0 

128.0 

0.838 

4.0 

135.2 

139.0 

137.1 

0.897 

4.5 

153.2 

152.5 

152.8 

1.000 

5.0 

155.0 

154.5 

154.8 

1.013 

5.5 

158.9 

159.8 

159.4 

1.043 

6.0 

152.6 

153.1 

152.8 

1.000 

6.5 

155.6 

154.3 

155.0 

1.014 

7.0 

148.4 

148.7 

148.6 

0.973 

7.5 

145.9 

146.1 

146.0 

0.956 

8.0 

148.4 

149.3 

148.9 

0.974 

8.5 

142.5 

142.5 

0.932 

9.0 

134.1 

134.1 

0.878 

9.5 

126.6 

126.6 

0.828 

10.0 

115.1 

115.1 

0.753 

10.5 

110.0 

1 10.0 

0.720 

ILLUMINATION  UNIFORMITY  TEST  DATA 


ILLUMINATION  UNIFORMITY  TEST  DATA  (Continued) 


Distance, 

Horiz 

Intensity, 

mV 

Norm 

Value 

Intensity, 

mV 

Norm 

Value  5 Mar  76 

8.6 

142.1 

0.899 

.7 

. 

139.5 

0.883 

.8 

137.9 

0.873 

.9 

137.8 

0.872 

9.0 

139.9 

0.871 

138.0 

0.873 

9.5 

126.4 

0.787 

— 

— 

10.0 

117.2 

0.729 

- 

- 

CA-4 


ILLUMINATION  UNIFORMITY  TEST  DATA 


Position 

Across 

Drum, 

inches 


• U 

.7 

.8 

.9 

6.0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.9 

7.0 
.1 
.2 
.3 
.4 
.5 
.6 
.7 
.8 
.9 

8.0 

.1 


EXPANDED  SCALE 

Approx  35-V  Input  I Approx  40-V  Input  I Approx  11 5-V  Input 


Relative 

Intensity 

Output, 

millivolts 


81.9 

81.0 

81.7 

80.3 

80.5 

77.1 

78.3 

79.2 

78.7 

77.2 

80.2 

74.1 

74.7 

74.6 

75.7 

73.6 

75.3 

74.7 

75.4 

74.4 

74.6 

74.2 
74.4 

76.6 

76.3 

74.4 

73.6 


Normalized 

Values 


1.062 

1.051 

1.060 

1.041 

1.044 

1.000 

1.016 

1.027 

1.021 

1.001 

1.040 

0.961 

0.969 

0.968 

9.982 

0.955 

0.977 

0.969 

0.978 

0.965 

0.968 

0.965 

0.965 

0.994 

0.990 

0.965 

0.955 


Relative 

Intensity 

Output 

millivolts 


159.5 

159.5 
159.4 
159.8 

158.0 

152.1 

154.1 

157.2 

157.3 

157.7 

156.8 

152.4 

154.6 

157.6 
157.1 

152.8 

150.7 

152.6 

153.9 

153.6 

150.4 

152.0 

151.1 

154.4 

153.4 
151.1 

147.6 
150.3 


Normalized 

Values 


1.049 
1.049 
1.048 
1.051 
1 .039 
1 .0000 
1.017 
1.034 
1.034 
1.037 
1.031 
1.002 
1.016 
1.036 
1.033 
1.005 
0.991 
1.003 
1.012 
1.010 
0.989 
0.999 
0.993 
1.015 
1.009 
0.993 
0.970 
0.998 


Relative 

Intensity 

Output 

millivolts 


1833 

1804 

1814 

1792 

1799 

1703 

1743 
1751 

1744 
1697 
1777 
1638 

1641 
1655 
1687 
1603 
1652 
1651 
1669 

1642 
1637 
1624 

1643 
1699 
1686 
1645 
1585 


Normalized 

Values 


1.076 
1.059 
1.065 
1.052 
1 .056 
1.000 

1.023 
1.028 

1.024 
0.996 
1.043 
0.962 
0.964 
0.972 
0.991 
0.941 
0.970 
0.969 
0.980 
0.964 
0.961 
0.954 
0.965 
0.998 
0.990 
0.966 
0.931 
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APPENDIX  B (TO  TR  2020  APPENDIX  C): 


A]  ,!.)\V  [>,  5V670  SERIES 


OPTICAL 

INCREMENTAL 

ENCODERS 


Features 

• One  input  voltage  ( -*  5VDC) 

• Quadrature  and  bidirectional  pulsed  outputs 
from  TTL  internal  electronics 

• Single  100,000  hour  light  source,  field 
replaceable  without  calibration 

• Resolutions  to  48,000 

• Solid,  hollow  or  through  shaft  options 
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and  it’s  what’s  inside  that  counts! 
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This  is  the  Baldwin  Divided  Circle 
Machine,  whose  output  results  in  the  pro- 
duction ol  the  world’s  most  accurate  op- 
tical encoders  There  is  only  one  such 
machine,  but  there  are  hundreds  of 
Baldwin  Encoder  customers  who  can 
prove  this  equation: 

BDCM  0.3  arc  seconds 
wherein  the  Baldwin  Divided  Circle 
Machine  (BDCM)  equals  centerline-to- 
centerline  accuracies  better  than  0 3 arc 
seconds  of  true  position! 

Glass  disks  available  using  photographic 
emulsion  or  metallic  coatings 

If  your  specifications  and  product  Integ- 
rity depend  upon  the  ultimate  in  encoder 
accuracy,  depend  on  Baldwin  Phone  the 
Baldwin  representative  nearest  you.  or 
contact  the  general  offices 
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CB-I 


ELECTRICAL  SPECIFICATIONS 

OUTPUT  CHARACTERISTICS 

PHOTOCELL 

Encoders  without  electronics 


Avg.  P-P  Swing 


Avg.  Internal 
Shunt  Resistor 


5V670  38MV 3.0K 

5V671 38MV 3.0K 

5V672 38MV 3.3K 

5V673  36MV 3.3K 

5V674  36MV 3.3K 

5V675 35MV 3.3K 

5V676 33MV 3.3K 

5V677  33MV 3.3K 

5V678 31  MV 3.3K 

The  encoders  have  resistors  installed  in  parallel 
with  the  photocell  outputs  for  calibration  pur- 
poses. For  maximum  accuracy  the  outputs  should 
be  discriminated  at  20MV. 


Encoders  with  Electronics 
Option  A or  AZ 

Binary  “1" 

Open  circuit  voltage  . . + 3.8VDC  ± 0.5VDC 
Output  impedance  . 160  ohms,  typical 
Risetime  and  falltime©  200  n sec.,  maximum 
Binary  "0” 

Open  voltage + 0.4VDC,  maximum 

Sinking  current 16.0ma.,  maximum 


PHOTOCELL  OUTPUT  WAVEFORMS 


ZERO  REF 
OPTION 


J 360  ' 

ELECT 
DEGREES 


SCHMITT  TRIGGER 
OUTPUT  WAVEFORMS 
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Encoders  with  Electronic  Option  B, 
BZ,  C,  CZ,  D or  DZ ® 

Binary  “1" 

Open  circuit  voltage  . . +3.8VDC  + 0.5VDC 
Output  impedance  . . . 160  ohms,  typical 

Pulse  widths 4 ,isec.,  + 1, — 2 ,isec. 

Risetime  and  falltime  ® 200  n.sec.,  maximum 
Binary  "0" 

Output  voltage +0.4VDC..  maximum 

Sinking  current 16.0ma„  maximum 

For  options  B.  BZ,  C.  CZ.  D & DZ  the  count 
pulses  appear  on  one  of  two  output  lines,  CW  or 
CCW.  depending  on  direction  of  shaft  rotation. 

<1 1 NiMumt  and  felltime  measured  from  10%  to  90%  level 
(>  The  zero  reference  pulse  occurs  coincidentally  with  a count  pulse 
tor  logic  options  only 

(Ji  ^uiee  width  measured  si  ths  50%  level 


PULSED  OUTPUT  WAVEFORMS 
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ZERO  REF 
OPTION 


CB-2 


FREQUENCY  RANGE 


AVERAGE  PHOTOCELL  OUTPUT  vs  FREQUENCY 


OUTPUT  FREQUENCY  RANGE 
Minimum:  Ohz  all  models 

OPTIONS 

Maximum:*1  AtB  C D 

SV670  thru  5V676  50*  Mz  100KHI  100KHI 

5V677  and  5V678  20KH1  40KHI  tOKHl 

For  models  without  internal  elec- 
tronics operating  frequencies  at 
output  will  be  determined  by  ex- 
ternal electronics.  Reter  to  photo- 
cell output  vs  frequency  charts  for 
typical  curves. 

• ‘Higher  operating  frequencies  available 
upon  special  order 


; 20  MKa 
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POWER  REQUIREMENTS 


Encoders  without  electronics : 5.0VDC:t5%  @ 330  ma. 

Encoders  with  electronics 


Option 

+5.0VDCrt5% 

Option 

+5.0VDC±5% 

A . . 

360  ma. 

C 

385  ma. 

AZ 

364  ma. 

CZ 

393  ma. 

B 

376  ma. 

D 

385  ma. 

BZ 

390  ma. 

DZ 

393  ma. 

Power  requirements  calculated  at  no  load. 

Baldwin  model  P5V  power  supply  is  available  to  supply  power  for  any  encoder 
option. 

a 

Baldwin  BC  60  counters  are  complementary  units  for 
any  encoder  with  direction  sensed  options. 


ACCURACY 


OPTIONS 

B 

C 

D 

Bit  to  Bit 
RMS(TYP) 
Absolute 

2 sec. 

13  sec. 

15  sec. 

position 

RMS(TYP) 

4 sec. 

8 sec. 

9 sec. 

As  resolution  increases.  RMS  error  decreases 
slightly  in  Option  B and  significantly  more  in 
options  C and  0. 

Accuracy  figures  were  derived  from  model  5V675 
encoders  coupled  to  a Moore  divided  engine  at 
21  fC. 
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DESIGN  FACTORS 


S'  ‘ ' l Off  K : / 1 * 


Solid  Shaft  Hollow  Shalt  Through  Shaft 

Weight,  max 4 lb.  8 oz 5 lb.  7 oz 4 lb.  14  oz. 

Starting  torque,  max 3 in.-oz 6 in.-oz 3 in.-oz. 

Running  torque,  max 2 in.-oz 3 in.-oz 2 in.-oz. 

Bearing  fatigue  life 50  x 10*  rev 3x10*  rev 50  x 10*  rev. 

Moment  of  inertia 0.037  oz.-in.-sec.’ 0.154  oz.-in.-sec.’ 0.0375  oz.-in.-sec.’ 

Maximum  slew  speed 15,000  rpm 5,000  rpm 15,000  rpm 

Maximum  angular  acceleration  (all  models)  — 50,000  rad./sec.> 


Hollow  Shaft 


SOLID  SHAFT  OUTLINE 


HOLLOW  SHAFT  OUTLINE  

[•••’•a  " "***"  rr  aw  ** 
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THROUGH  SHAFT  OUTLINE  L ‘ 
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Working  temperature  range  : v— 

Encoder  only  -40°C  to  -*-70°C  “ 

Encoder  with  electronics  • ■"*  • 

0°C  to  + 70°C 
Storage  temperature  range: 

Encoder  only  -65°C  to  +85°C 
Encoder  with  electronics 
-55CC  to  -r85°C 

Altitude:  ""fi 

70,000  ft.,  max. 

Vibration: 

Meets  or  exceeds  requirements 
of  MIL-E-16400F:  MIL-E-5272C. 

Shock : 

50g  s@  11  ms  . meets  or  exceeds 
requirements  of  MIL-E-5272C, . 
MIL-E-5400K;  MIL-T-5422E 
Humidity: 

98%  rh.  max.  Avoid  condensation. 

* Wide  temperature  range  models  alto  available  on  apacial  order 


1 .NR 

f 

1 \ 


i 

li  *5-*. 


rt  101  McALMONT  . LlTTir.  ROCK.  ARKANSAS  72203  . PHONE  (501)  375-7351 

Represented  by 


NOTICE:  TIm  design  and  specifications  of  the  instruments  and 
accotaorlos  illustrated  and  described  in  tMs  bulletin  are  subiect 
to  improvement  without  notice. 
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APPENDIX  C (TO  TR  2020  APPENDIX  C): 


LENS  CALCULATIONS 


S 


s'~\y 


sensor 


d = 8.5  inches 

d'  = 0.890  inches  for  Fairchild  CCD  121 


S _ S'  S 
d d'orS' 
S = 9.550  S' 


JL  = J_  + J_  = 

f S S 

1_  1.105 
f S' 

S '=  1 . 1 05f 


: d_=A.5—_9 
d 0.890" 

1 +!  _ 10.550 

9.550s'  S'  9.550s' 


For  f = 55  mm,S  '=  60.759  mm  = 2.392  (a  flat  field  lens) 


S = 22.846  inches 


Ref:  TR  1965 
P 36-45 


0 = 90°  - tan-1  -~'84^=  90°  _ 79.462°  = 10.538° 
4.25 

cos  0 = 0.983 

cos4©  = 0.9342 

% end  intensity  = 93.42% 

% droop  = 6.58%  (±3.29%) 

For  end  intensity  % > ^7  = 0.984375  = cos4© 

64 

cos  0 = 0.99607 
0 = cos”1  0.99607  = 5.0809° 


S = 4.25  cot  0 = 47.80  inches 
Then  S = ^9  55  = 5.00  inches 


= 0.2207 


■ 





J I 


1 


111611  f S V 47.8  + 5.0 


f = 4.531  inches  = 1 15.07  mm 


Conclusions 


Uniformity  of  intensity  at  scanner  photodiodes  is  dictated  by  cos^©  law. 


1. 

2.  Using  a Nikon  55-mm  flat  field  lens  will  produce  an  illumination  droop  at  the 
edges  of  the  copy  to  93.42%  of  the  center. 

3.  Conversely,  to  produce  an  illumination  droop  of  less  than  1 /64  (±0.5  lsb  for 
26  gray  scale  levels),  the  lens  to  copy  distance,  s,  must  be  at  least  47.8  inches. 
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APPENDIX  D (TO  APPENDIX  C): 


ABERRATION  ERRORS 
FOR 

CURVED  SURFACE  TRACKING  IMAGING 

S = Spacing  of  pel  resolution  in  inches  at  object  plane 
N = Number  of  pels  in  the  direction  of  copy  motion 
E = Error  in  inches  at  extreme  of  object  plane 
W = Width  of  copy  scanned  in  inches 
R=  Radius  of  transport  drum 
D = Distance  from  object  plane  to  lens  in  inches 

Let  2P  = true  height  of  copy  scanned.  Then  P = height  of  true  image  above  drum 
axis.  Assuming  a piece  of  copy  having  a length  2P  is  attached  to  the  curved  drum,  then 

p _ 27tR0 

360° 

P also  = NS/2 
h = R sin  0 

d = R - R cos  0 = R[  1 - cos  0], 

If  the  lens  is  assumed  to  have  X,  Y,  Z coordinates  of  0,  0,  0,  then  the  coordinates 
of  the  point  Q can  be  stated 


CD-I 


Ml  | 


1 


Xq,  Yq,  Zq  = — , R sin  ©,  R[  1 - cos  ©]  + D. 


The  coordinates  of  the  point  J can  be  found  by  the  intersection  of  the  line  QL 
with  the  tangent  image  plane. 


Xj  = XQ  * Zr 


YJ=Y<^ 


zj  = z<rf-  = D 

ZQ 


E =W_x  =W  W/  D \-W/]  D \ 

x 2 J 2 ~ 2 \R[  1 - cos  0]  + D / 2 \ R[1-cos©]  + d) 


^ _p_Y  = DR  sin  Q 

Y ” J " 2 R[  1 - cos  0]  + D 


where 


0 _ 90  NS  degrees 
ttR 

For  USPS/NELC  time  delay  integration  (TDI)  experiments  the  following  parameter 
values  are  under  consideration:  Resolution  of  200  pels/in  only  S = 0.005  in.  Lens  focal 
length  = 55  mm  only 


DRUM  RADII 


Rj  = small  drum  test  bed  (12-in  crcmf)  - 1.90985  in 
R2  = large  drum  test  bed  (40.96-in  crcmf)  = 6.5 190  in 


COPY  WIDTHS 


For  SID  5 1 232  device  (320  pels),  W j = 1 .6  in 
For  RCA  prototype  TDI  device  (748  pels),  W2  = 3.74  in 
For  RCA  page  width  TDI  device  ( 1 700  pels),  W3  = 8.5  in 
For  RCA  page  length  TDI  device  (2200  pels),  W4  = 1 1 .0  in 
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PEL  SIZES 


For  SID  5 1 232  device,  B j = 1.2  mils 
For  RCA  TDI  imagers,  B2  = 0.6  mils 

NUMBER  OF  PELS  IN  DIRECTION  OF  COPY  MOTION 

Maximum  considered,  SID  51232,  N,  =512 
Maximum  tested,  SID  51232,  N->=190 

RCA  prototype  option  1 , 

RCA  prototype  option  2, 

RCA  prototype  option  3, 


N3=  96 
N4=  64 


N5=  32 

Given  a 55-mm  lens  and  a fixed  resolution  of  200  pels  per  inch,  the  distance  from 
lens  to  drum  is  dependent  on  imager  resolution  only. 


CALCULATING  FOR  USE  WITH  1.2-MIL  PELS 


Dj  _ S Q.0Q5  ^ _ . .... 

g.  B,  0.0012  ’orDl  4166el 


L = ± +_!_  = 
f d,  e, 


_I I 5.166 

4.1168,  8,  4.1668, 


n _F5.166_C v 5.166  v in 

1 4.166  4.166  25.4  mm 

1 

D,  =4.1668,  = 11.1876  in 


= 2.6850  in 


CALCULATING  FOR  USE  WITH  0.6-MIL  PELS 
D?  S 0.005 


B~  0.0006 


, or  D?  = 8.338, 


„ _ F 9.33  „ 9.33  x, 

^ o j j mm  a 0 ^ ^ X 


in 


8.33 
D2  = 20.21  in 


8.33  25.4  mm 


= 2.42520  in 


SOME  DRUM  SUBTENDED  ANGLES  OF  SELECTED  RADII  AND  PEL  HEIGHTS 
For  large  drum  and  5 1 0 pels, 

^ 90  NS  degrees  _ 90  X 5 1 2 X 0.005  deg  _ , , -,r  j 

“l  - ll.zodeg 


6.519  tt 
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For  large  drum  and  1 90  pels, 


02  = 


9°6X519ir  X 190  deg  = 0.0219726  X 190  deg  = 4.175  deg 


For  large  drum  and  96  pels,  ©3  = 2.109  deg 
For  large  drum  and  64  pels,  ©4  = 1 .406  deg 
For  large  drum  and  32  pels,  ©5  = 0.703  deg 
For  small  drum  and  190  pels, 

©4  = 90  909I7  x 190  de«  = 0 075  X 190  def=  = 1 4-250  de8 

For  small  drum  and  96  pels,  ©5  = 7.2  deg 
For  small  drum  and  64  pels,  ©g  = 4.8  deg 
For  small  drum  and  32  pels,  ©7  = 2.4  deg 
Example  1 , using  large  drum,  512  pels  of  SID  51232  imager: 


R(l-cos  0)  + 


_ \ = 1 A—  / 1 1 1,1876  in \ 

D/  2 \ 6.519  [1-0.980781  + 11.1876  / 


Ex  = 0.00886  in 
NS  DR  sin  © 


- ins  ui\  bin  ci  _ , 14.22832  _ 

Ex~—  ~ Rll-bos©]^-1'28  - 11.31286  “ 002229  m 


Example  2,  using  large  drum,  190  pels  of  SID  51232  imager: 

Ex”^T“'n(1"  6.519  (1-0.997437]  + TTTS75")=  00012  ln 
Ey  , o.4S  („  - 11'876iX16^39X0  0728-  = 0.006,3  in 
Example  3,  using  large  drum,  96  pels  of  RCA  TDI  prototype  (748  pels  wide): 

Ex=  1.87  in  ( 1 - 6 519  [1-0.9993226]  +20.21  ) = 187  in  ( 202 


= 0.00041  in 


Ey  = 0.24  in 


6.519  [1-0.9993226] 


1,21  X 6.519  X sin  2.109°\  _ 
.519  [1-cos  0)1  + 20.21  / 


>0.21  \ 
.2144/ 


00149  in 


Example  4,  using  large  drum  64  pels  of  RCA  TDI  prototype: 

Ex=  1.87  in  (l  " 6.519  (1-cos  1.406° ) + 20.21  ) = 0 00018  in 

c niA-  20.21  X 6.519  X sin  1.4°,^  3.2327  _nnnnn,:.. 

Ey  0.16  in-  0.0019627  + 20.21  0 16  “ 20.21 196  000006  in 
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Example  5,  using  large  drum,  96  pels  of  RCA  page  width  imager  ( 1 700  pels  wide): 


Ex  = 4.25i„ 


00093  in 


Ey  = 0.24  in  - 0.2385 1 in  = 0.00149  in 


Example  6,  using  small  drum  test  bed,  190  pels  of  RCA  SID  5 1 232  (320  pels  wide): 


r,  1.6  in 

tx  2 


/,  1118Z6 \=0 

\l  1.9099  [1-cos  14.25°]  + 1 1.1876 ^ 


= 0.00418  in 


Ev  - 0.48  in  - .1 1 • 1876  X L9099  sin  14.25°  = ao,233  j 


1.24636 


Example  7,  using  small  drum  test  bed,  96  pels  of  RCA  SID  5 1 232  (320  pels  wide): 


„ _ 16  in 


('•T 


11.1876 

9099'/2  [ 1-cos  7.2°]  + 11.1876 


= 0.00108  in 


^ • 11.1876  X 1.9099  sin  7.2°  

Ey  = 0.24  in j 1~20266 0 00094  in 


TRACKING  ERROR,  INCHES  TRACKING  ERROR,  INCHES 
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INTRODUCTION 


This  project  is  one  of  six  detailed  technical  summary  reports  provided  as  inputs 
from  NELC  to  the  USPS  which  discuss  specific  areas  of  high  importance  and  interest  on 
the  subject  of  image  acquisition.  The  process  of  acquiring  and  analyzing  the  images  used  as 
subjects  in  this  report  required  the  full  performance  of  essentially  all  the  hardware  and  soft- 
ware resources  of  the  USPS/NELC  test  bed.  We  are  pleased  to  add  that  after  the  long  and 
painful  process  of  debugging,  the  entire  operation  was  flawless. 

A digitized  image  contains  3.74  million  6-bit  words  which  are  handled  and  modified 
dozens  of  times  during  acquisition  and  analysis.  Computations  can  be  made  on  each  hard- 
copy page  to  show  that  exactly  all  the  pels  are  accounted  for. 

The  title  of  the  report  indicates  that  the  only  use  of  data  acquired  is  for  compres- 
sion. This  is  not  the  case.  The  data  are  also  useful  for  the  establishment  of  threshold, 
choice  of  illumination  color,  and  gain  control  of  the  analog  output  signal  of  the  imaging 
device  itself.  These  uses  of  the  data  are  described  in  the  Prestorage  Processing  summary 
report  dated  May  1976. 

Due  to  the  limitations  of  schedule,  the  data  base  of  copy  materials  to  be  tested 
during  this  time  frame  was  somewhat  restricted,  and  a broad  statistical  basis  for  our  con- 
clusions was  not  obtained.  It  is  projected,  however,  that  analyses  of  this  type  will  be 
continued  throughout  the  remaining  year  of  the  program  and  that  a more  creditable  sub- 
stantiation of  results  will  be  obtained  during  this  period. 
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RATIONALE  FOR  COMPRESSION  STUDY 

Although  NELC’s  purview  in  image  acquisition  does  not  contain  a requirement  for 
the  development  of  US  Postal  Service  compression  algorithms,  there  are  a number  of  reasons 
for  which  NELC  should  perform  the  study  described  by  this  report.  The  team  members  of 
NELC  Scanner  Project  have  at  least  an  acquaintanceship  with  the  various  fixed  and  variable 
run  length  coding  (RLC)  techniques  and  also  the  one-  and  two-dimensional  Hadamard  and 
cosine  transform  functions  investigated  by  other  divisions  in  NELC.  From  the  imaging  data 
acquired  to  date  there  has  been  no  indication  as  to  which  of  these  choices  of  compression 
may  be  more  suitable  for  the  Postal  Service  data  transmission  system.  Perhaps,  then,  the 
most  important  reason  for  the  compression  study  is  to  understand  the  various  methods  that 
exist  for  compression  and  assure  that  we  do  not  conceive  or  recommend  a prototype  design 
for  USPS  scanner  terminal  equipments  which  would  preclude  the  use  of  one  or  more  of  the 
better  compression  approaches. 

A second  reason  for  studying  compressibility  is  the  possibility  of  saving  or  reducing 
the  quantity  of  high-speed  solid-state  storage  necessary  to  contain  an  entire  page  of  latent 
image  in  digital  form. 

A third  reason  for  studying  compression  is  related  to  the  wide  versatility  of  the  test 
bed  itself.  The  prescanner  concept  which  provides  for  pel  brightness  statistics  resulting  from 
an  image  analysis  may  afford  sufficient  a priori  knowledge  of  a particular  image  to  allow  a 
choice  of  compression  algorithms  to  be  invoked  on  a main-scanned  image.  This  would 
result  in  considerable  savings  in  frame  store  page  memory  as  described  above.  The  test  bed 
equipment  contained  about  95%  of  the  hardware  capability  to  perform  the  analysis  neces- 
sary for  the  study  of  compressibility  of  images  using  run  length  coding.  Only  a minor 
amount  of  additional  hardware  was  required  in  order  to  be  able  to  tabulate  the  run  length 
coding  in  both  Gray  and  binary  codes  in  order  to  document  the  compressibility  of  pages  of 
copy  of  various  types. 

The  fourth  reason  for  the  study  is  to  assess  the  credibility  of  the  claims  of  many 
companies  in  the  field  of  compression  offering  proposals  containing  high  compression  ratios. 

The  fifth  and  last  reason  for  the  compression  study  is,  of  course,  the  conservation  of 
bandwidth.  At  20  pages  per  second  the  existing  digital  image  bandwidth  required 
approaches  504  megabits  per  second.  Any  modest  contribution  which  may  stem  from  the 
NELC  test  bed  investigation  will  be  worthwhile  in  the  reduction  of  this  formidable  band- 
width requirement. 
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USPS  GENERAL  IMAGING  REQUIREMENTS 


The  design  goals  for  USPS  image  acquisition  are  exceedingly  demanding  on  scanner 
and  processing  electronics  technology.  These  goals  are  discussed  in  detail  in  the  First 
Annual  Report  for  Advanced  Mail  Systems  Scanner  Technology,  dated  22  October  1975. 
The  desired  operating  specifications  are  included  here  for  reference  as  follows: 

Copy  rate  Up  to  20  sheets  per  second 

Copy  size  8'A  by  1 1 inches 

Copy  velocity  Up  to  240  inches  per  second 

Image  resolution  200  picture  elements  (pels)  per  inch  by  200  pels 

per  inch 

Images  accommodated  Text  or  continuous  tone  photographic  materials, 

either  black  and  white  or  color 

The  resulting  imaging  requirement  includes  the  acquisition  of  48  000  scan  lines  per 
second  at  about  1 700  pels  per  line;  this  is  a video  rate  of  approximately  84x1 06  pels  per 
second.  Dynamic  range  of  the  image  scanner  must  be  at  least  2^  (or  64)  brightness  levels. 


EXPECTATIONS 

Before  the  data  were  acquired  for  the  compression  study,  there  were  a number  of 
expectations  which  were  predicted  to  result  from  the  study.  These  will  be  listed  here  but  will 
be  discussed  as  the  data  are  analyzed  further  in  the  report.  The  first  expectation  was  that 
we  would  have  no  difficulty  in  differentiating  most  black  and  white  bilevel  images  from 
continuous  tone  images.  This  is  necessary  to  exploit  a strategy  that  distinctly  different 
compression  algorithms  may  be  used  for  bilevel  and  continuous  tone  images.  Those  used 
with  bilevel,  or  black  and  white  only,  may  contain  compression  ratios  which  are  exceed- 
ingly high  with  respect  to  those  required  for  continuous  tone  images. 

There  was  also  an  expectation  that  statistical  results  from  “similar”  types  of  images 
will  be  in  the  final  analysis  somewhat  “similar.”  Although  our  data  base  for  this  report  will 
be  extremely  small,  we  hope  to  prove  that,  for  example,  typewritten  pages  have  a particular 
and  identifiable  set  of  statistics  and  that  regardless  of  contents  of  a page,  size  of  type,  color 
ribbon,  etc,  the  data  will  be  restricted  to  a classification  which  can  be  recognized  by  com- 
puting techniques. 

An  obvious  expectation  is  that  there  will  be  longer  runs  of  run  length  coding  on  the 
higher-order  bit  planes.  We  also  expect  that  the  use  of  Gray  code  as  opposed  to  binary  code 
may  double  the  length  of  the  runs  for  a particular  image.  If  this  is  true,  then  the  number  of 
runs  will  be  divided  by  two  and  a 2-to-l  increase  in  compressibility  will  be  achieved. 

In  analyzing  the  data,  it  is  hoped  that  we  can  make  some  recommendations  to  the 
USPS  as  to  the  most  promising  compression  strategies  which  they  may  wish  to  pursue. 


SUBJECTS  TESTED 


The  time  to  acquire  the  test  data  shown  in  the  Test  Procedure  section  is  approxi- 
mately 3.5  hours  of  test  bed  time  per  subject.  Therefore,  the  number  of  subjects  to  be 
tested  for  inclusion  in  this  report  has  been  somewhat  restricted.  The  following  types  of 
documents  were  used  as  subjects  for  this  report. 

1 . IT/8  - Plain  white  page  of  typing  paper,  acquired  at  a lens  opening  of  f 1 6 
with  no  filter. 

Testing  a white  page  defines  the  uniformity  of  reflectance  from 
copy  after  illumination  correction.  It  also  establishes  the  average 
brightness  compared  to  the  white  standard. 

2a.  IT/3  - Our  standard  typed  page,  at  f 16  with  no  filter  (fig  D1 ). 

The  typed  page  with  no  filtration  gives  evidence  of  change  of 
statistics  due  to  “typical”  typed  message  on  the  same  page  stock 
as  analyzed  from  test  1. 

2b.  IT/5  - Typed  page,  at  f5.6  with  red  filter  and  adjusted  illumination. 

2c.  IT/4  — Typed  page,  at  f5.6  with  green  filter  and  adjusted  illumination. 

2d.  IT/6  — Typed  page,  at  f5.6  with  blue  filter  and  adjusted  illumination. 

These  tests  show  any  changes  in  reflectance  of  paper  background  and  ink  (TECH  II 
IBM  ribbon)  as  a function  of  illumination  color. 

2e.  IT/2  — Typed  page,  f stop  adjusted,  no  filter,  thresholded. 

This  test  will  show  the  results  of  a fixed  selected  threshold  level  on  illumination 
corrected  data.  The  analysis  of  bit  plane  6 will  give  run  length  compressibility 
figures  for  binary  transmission  of  “typical”  typed  page. 

3.  IT/9  - IEEE  facsimile  chart,  at  f 1 6 with  no  filter  (fig  D2). 

The  IEEE  facsimile  chart  is  widely  used  and  reported  on  by  others.  Having  statistics 
will  allow  comparison  with  other  data  bases. 

4.  IT/11  - Photograph  of  Ampex  plant,  at  f 1 6 witii  no  filter  (fig  D3). 

5a.  IT/7  Photograph  of  40.96-inch  Pitney  Bowes  (PB)  drum,  at  f 1 6 with  no 
filter  (fig  D4). 

5b.  IT/13  - Photograph  of  40.96-inch  Pitney  Bowes  (PB)  drum,  f adjusted, 
dynamic  range  amplified,  no  filter. 

By  readjusting  level  and  f stop,  we  can  expand  the  contrast  to  utilize  the  entire  64 
digital  brightness  levels.  The  customer  may  not  wish  to  have  the  contrast  range  of  his 
subject  matter  increased  as  it  is  acquired.  For  this  test,  an  analysis  of  the  appearance  of 
the  enhanced  results  will  be  meaningful. 

6.  IT/10  - USPS  Headquarters  announcement  771 , f 1 6 no  filter  (fig  D5). 

USPS  771  appears  to  be  a Xerox  print.  Since  it  has  a heading  and  logo  block,  we 

can  tell  if  it  changes  the  statistics  appreciably. 

7.  IT/1 2 - Sample  of  Versatec’s  electrostatic  printer  output,  printed  at  a 
resolution  of  200  by  200  dots  per  inch  (fig  D6). 
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Mr.  W.  J.  Miller,  Director 

Office  of  Advanced  Mail  Systems  Development 

11711  Parklawn  Avenue 

Rockville,  Maryland  20852 

Gentlemen: 

This  is  a sample  of  the  letter  we  propose  to  use  as  a 
"standard"  for  imaging  experiments  at  NELC,  San  Diego.  It 
was  made  on  a Wang  System  1222  Dual  Cassette  Typewriter 
which  consists  of  a modified  IBM  Selectric  typewriter,  two 
cassette  holders,  and  a magnetic  core  memory  capable  of 
storing  pages  of  data  such  as  this  letter.  The  cassette 
tapes  are  being  made  to  store  the  data  for  each  character 
in  United  States  of  America  Standard  Code  for  Information 
Interchange  ( US  AS  C II)  format.  This  is  a standard  seven 
bit  binary  code  for  each  character  which  is  widely  used  in 
industry.  In  USASCII  form  this  page  as  written  can  be 
exactly  defined  by  15099  bits  of  data  (excluding  signature, 
logo  or  header  information).  When  scanned  at  200  x 200 
picture  elements  per  inch  with  six  bits  per  element  for 
grey  scale  the  page  is  defined  by  22,440,000  bits. 

By  recording  the  contents  of  this  letter  on  cassette 
tape,  it  is  possible  to  reproduce  a quantity  of  duplicate 
originals,  all  nominally  exactly  the  same.  Since  the 
typewriter  is  an  IBM  Selectric  it  is  also  possible  to 
change  the  type  font  without  changing  the  message.  It  is 
also  possible  to  change  ribbons  (a  five-  or  ten-minute 
process)  to  yield  copies  of  differing  colors.  It  is  of 
course  possible  to  write  on  all  textures,  colors  and 
weights  of  paper  with  or  without  letter  head.  It  will  also 
allow  copies  of  this  text  to  be  analyzed  both  with  and 
without  signatures  of  various  colors. 

This  ability  to  provide  complete  parameter  selection  and 
consistency  control  for  analysis  of  thresholds,  contrasts, 
color  separation,  compressabi 1 i ty  coefficients,  and  char- 
acter fonts  will  be  of  great  benefit  in  quantifying  the 
requirements  of  U.  S.  Postal  Service  Scanner  technology. 


Frank  Martin 
NELC  Code  3100 
Problem  N451 


Figure  D1 . Letter  dated  22  Feb  76  to  WJ  Miller. 
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figure  D4.  Indoor  machinery  photograph 
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******** 


I am  pleased  to  announce  the  appointment  of  Joseph  F.  Morris 
to  the  position  of  Regional  Postmaster  General  for  the  Western 
Region  effective  August  13,  1976,  incident  to  the  resignation 
of  William  J.  Sullivan  from  that  post. 

Mr.  Morris,  a career  postal  employee  of  more  than  27  years,  began 
his  postal  service  as  a substitute  city  carrier  in  April  of  1949 
at  the  Ardmore,  Pennsylvania  post  office.  His  service  has 
included  numerous  supervisory  and  managerial  positions  at  the  local, 
district  and  regional  levels.  Among  the  positions  he  has  held  are 
foreman,  postmaster,  postal  service  officer,  regional  staff  member 
and  is  currently  the  manager  of  the  Delaware  Valley  District  of 
the  Eastern  Region. 

The  selection  of  Joe  Morris  to  be  the  Regional  Postmaster  General 
for  the  Western  Region  is  a further  continuation  of  the  policy  of 
the  U.  S.  Postal  Service  to  promote  qualified  career  postal  employees 
to  the  top  managerial  positions  in  the  Postal  Service. 

Denjamin  F.  Bailar 

Postmaster  General 


Figure  D5 . Headquarters  Announcement  77 1 . 


TESTS  TO  BE  MADE 

For  the  subjects  to  be  tested,  three  types  of  statistics  will  be  taken  - pel  brightness, 
first  derivative,  and  run  length  statistics.  The  pel  brightness  statistics  give  the  distribution 
of  the  intensity  levels  occurring  in  an  image;  that  is,  what  portion  of  the  area  of  an  image  is 
black  or  gray  or  white.  More  specifically,  totals  are  accumulated  on  the  number  of  occur- 
rences of  pels  at  each  of  the  64  possible  brightness  levels,  throughout  an  entire  image.  The 
brightness  statistics  may  then  be  displayed  in  histogram  form,  an  example  of  which  is  shown 
in  figure  D7.  This  figure  is  representative  of  data  obtained  from  a typewritten  page.  The 
large  accumulation  of  pels  occurring  at  high  brightness  levels  corresponds  to  the  background 
of  the  typewritten  page.  The  smaller  accumulation  of  pels  occurring  at  lower  brightness 
levels  represents  that  area  of  the  page  covered  by  typewritten  characters.  The  ratio  of  these 
two  areas  of  the  curve  is  a direct  relationship  to  the  actual  print  density  on  the  page. 

The  first  derivative  statistics  represent  the  magnitudes  of  changes  in  the  brightness 
information  along  each  scanned  line  of  an  image.  To  accumulate  these  statistics,  the 
absolute  value  of  the  difference  between  tv/o  successive  pel  amplitudes  is  accumulated  for 
each  pel  in  an  image,  as  in  figure  D8.  This  information  is  displayed  in  histogram  form  as 
shown  in  figure  D9.  In  this  figure  the  number  of  occurrences  is  plotted  for  each  of  the  64 
possible  differences  between  two  successive  pels.  The  lower  portion  of  the  curve  corresponds 
to  relatively  slow-changing  image  information  and  the  upper  portion  of  this  curve  represents 
the  magnitude  of  the  first  pel  on  each  line,  since  the  first  difference  on  a line  is  taken  as  the 
difference  between  0 and  the  first  brightness  level. 

In  the  third  type  of  statistics,  run  length  statistics,  the  numbers  of  runs  of  lengths  1 
through  64  are  accumulated.  To  illustrate  the  method  used,  refer  to  figures  DIO  and  Dll. 
Figure  DIO  shows  typical  pel  values  for  a portion  of  an  image  line  and  how  the  bit  planes 
are  organized.  Since  run  length  coding  may  be  performed  only  on  a single  bit  stream,  a 
particular  bit  plane  must  be  selected  at  a given  time.  In  this  example,  bit  plane  4 has  been 
selected  for  analysis. 

Figure  D1 1 shows  the  accumulation  of  runs  of  zeros  and  runs  of  ones.  The  NELC 
digital  image  analyzer  is  designed  to  accumulate  statistics  on  runs  of  zeros  and  ones  inde- 
pendently, since  certain  coding  schemes  operate  differently  on  each.  Thus,  for  a given  bit 
plane  and  a given  polarity  of  image  data,  the  total  numbers  of  runs  of  lengths  1 through  64 
are  counted  for  the  entire  image.  In  the  example  of  figure  Dll  bit  plane  4 has  been  selected 
and  runs  of  both  polarities  are  shown.  For  runs  of  zeros  there  would  be  an  increment  in  the 
number  of  runs  of  length  2 and  the  number  of  runs  of  length  3.  For  runs  of  ones  there  would 
be  one  run  of  4 counted. 

The  general  characteristics  of  the  run  length  statistics  expected  are  that  the  low-order 
bit  planes  will  have  many  short  runs  and  few  long  ones.  The  higher-order  bit  planes  would 
then  exhibit  just  the  opposite  characteristics.  Also,  the  run  length  statistics  will  be  accumu- 
lated on  the  image  data  when  the  binary  data  are  converted  to  Gray  code.  The  Gray  code 
exhibits  the  desirable  characteristic  that  there  are  only  about  half  the  number  of  transitions 
(hence,  run  lengths)  within  all  but  the  most  significant  bit  planes.  This  should  give  a signif- 
icant improvement  in  the  compression  of  images  using  run  length  coding.  A comparison  of 
the  two  codes  is  shown  in  table  Dl. 


D-14 


BACKGROUND  BRIGHTNESS 

/PRINT  i 

/ BRIGHTNESS  / 


15  23  31  39  47  55  63 

BRIGHTNESS  LEVEL 

Figure  D7.  PEL  brightness  statistics. 
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Figure  D9.  First  derivative  statistics  (2). 
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Figure  DIO.  Bit  plane  selection. 


PEL  NUMBER 

P23 

P24 

P25 

P26 

P27 

P28 

P29 

P30 

P31 

PEL  BRIGHTNESS 

DECIMAL 

32 

a 

3 

46 

1 

63 

13 

30 

7 

16 

53 

BIT  PLANE  4 

1 0 

1 

0 

j 1 

1 

1 

1 

1 

0 

0 

0 

1 

I 

RUN  LENGTH 

1 

a 

1 

1 

1 

1 

1 

COUNTER 

1 1 
1 

2 

1 

• 1 

2 

3 

a 

■ 

1 

1 

2 

3 

1 

1 

1 

RUN  LENGTH 
BLACK  - O'j 

1 

1 

| 

1 

2 

1 

1 

1 

1 

3 

1 

1 

| 

TALLY 

LOCATIONS 

RUN  LENGTH 
WHITE  - I s 

1 

1 

1 

1 

1 

‘ 

r 

1 

1 

1 

1 

TALLY 

LOCATIONS 
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TABLE  Dl.  CODE  COMPARISON. 


Binary  Code 
Dj  D2  D3  D4 

1111  WHITE 

1110 
110  1 
110  0 
10  11 
10  10 
10  0 1 

10  0 0 

0 111 
0 110 
0 10  1 

0 10  0 

0 0 11 

0 0 10 

0 0 0 1 

0000  BLACK 

Number  of  13  7 15 

Transitions 


Gray  Code 

G1  G2  G3  G4 

1111 
1110 
110  0 
110  1 
10  0 1 

10  0 0 

10  10 
1 0 1 1 

0 0 11 

0 0 10 

0 0 0 0 

0 0 0 1 

0 10  1 

0 10  0 

0 110 
0 111 
12  4 8 
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TEST  BED  CONFIGURATION 

A block  diagram  of  the  NELC  image  scanning  test  bed  is  given  in  figure  D1 2.  A 
complete  description  of  the  large  drum  scanner  test  bed  is  given  in  the  Advanced  Imager 
summary  report,  with  the  exception  of  the  analog  preprocessing  and  digital  preprocessing 
sections,  which  will  be  added  to  the  system  at  a later  date.  A brief  description,  however, 
will  be  given  here. 

The  illumination  source  is  two  18-inch  fluorescent  lamps  with  a special  blend  of  red, 
green,  and  blue  phosphors  in  ratio  of  one,  two,  and  eight,  respectively.  This  ratio  when 
combined  with  the  silicon  response  of  the  CCD  imager  will  produce  nominally  flat  response 
throughout  the  spectrum.  Figure  D13  shows  a plot  of  the  illumination  spectral  response 
along  with  that  of  the  silicon  imager. 

The  paper  transport  drum  consists  of  a hollow  aluminum  drum  with  a circumfer- 
ence of  40.96  inches  and  a length  of  8-3/4  inches.  The  circumference  of  the  drum  was 
chosen  to  give  exactly  0.005  inch  of  surface  movement  per  pulse  output  of  a Baldwin  shaft 
encoder.  The  shaft  encoder  provides  a total  of  8192  pulses  per  revolution  of  the  drum. 

This  is  used  for  synchronizing  the  scanner  with  the  paper  movement. 

The  imager  used  for  these  tests  is  a Fairchild  CCD-121  with  1728  elements  organ- 
ized as  a linear  self-scanned  array.  The  lens  used  for  imaging  is  a Micro  Auto  Nikkor  55-mm 
0.5  lens.  It  is  specially  designed  for  flat  field  imaging  applications. 

The  output  from  the  imager  is  amplified  and  input  to  a sample-and-hold  unit,  and 
then  to  a 6-bit  analog-to-digital  (A/D)  converter  capable  of  10-megahertz  operation.  The 
output  from  the  A/D  converter  is  then  input  simultaneously  to  both  the  digital  image 
analyzer  and  the  memory  controller. 

The  memory  controller  is  a general-purpose  processor  with  special  consideration 
given  to  image  processing.  Two  levels  of  control  are  available  through  a microprogrammed 
firmware  implementation  of  hardware  function  and  a simplified  machine  language  instruc- 
tion set.  A complete  description  of  the  memory  controller  is  presented  in  the  Frame  Store 
Memory  and  Display  report,  dated  May  1976.  The  memory  controller  is  used  in  several 
ways  in  this  system.  To  test  high-speed  image  acquisition,  the  memory  controller  acts  as  a 
data  formatter,  packing  6-bit  picture  elements  into  48-bit  words  for  storage  in  the  frame 
store  memory.  For  image  analysis  the  memory  controller  is  used  to  store  image  data  on  one 
of  the  magnetic  tape  units.  The  memory  controller  then  reads  image  information  from  tape 
and  inputs  it  to  the  digital  image  analyzer  for  analysis.  Once  the  analysis  is  complete,  the 
memory  controller  reads  the  statistics  information  from  the  analyzer  and  formats  it  for 
display  on  either  the  CRT  monitor  or  the  CRT  terminal. 

The  frame  store  memory  as  it  now  exists  is  large  enough  to  hold  one-eighth  of  an 
8'/2-by-l  l-inch  image.  It  is  organized  as  65k  words  by  48  bits  wide.  The  cycle  time  on  the 
memory  is  650  nanoseconds,  allowing  a pel  input  rate  of  a maximum  10.5  megapels  per 
second,  which  is  the  required  data  rate  for  eight  such  memory  modules  to  capture  image 
information  at  a 20-page-per-second  input  rate 

There  are  currently  two  magnetic  tape  units  associated  with  the  test  bed.  There  is 
presently  one  magnetic  tape  unit  associated  with  the  magnetic  tape  formatter.  This  tape 
unit  has  a nine-track  1 600-bit-per-inch  format  with  a second  tape  unit  to  be  installed  at  a 
later  date.  The  third  magnetic  tape  unit  shown  in  the  diagram  is  a nine-track  800-bit-per- 
inch  tape  deck  which  will  be  removed  from  the  system  when  the  new  magnetic  tape  unit 
is  installed. 


The  digital  image  analyzer  is  a high-speed  device  using  emitter  coupled  logic  to 
gather  three  types  of  statistics  on  image  information  — pel  brightness  statistics,  first 
derivative  statistics,  and  run  length  statistics.  A complete  description  of  the  digital  image 
analyzer  may  be  found  in  the  Prestorage  Processing  report,  dated  May  1976. 

The  CRT  monitor  is  a Conrac  RQB  display  with  phase  lock  loop  conti<;i  of  both 
vertical  and  horizontal  sweep  rates  allowing  display  of  virtually  any  size  image.  Due  to  the 
resolution  limits  of  the  monitor  the  8'/2-by-l  1-inch  image  has  been  divided  into  20  equal 
segments  of  432  pels  by  440  lines  each  for  display. 

The  CRT  terminal  is  a Tektronix  4023  display  terminal  which  is  used  for  command 
entry  to  the  memory  controller  and  for  data  display  purposes.  Connected  to  the  CRT 
terminal  is  a Tektronix  4632  video  hard-copy  unit  which  is  used  to  make  copies  of  data 
displayed  on  the  CRT  terminal. 


r 

TEST  PROCEDURE 

The  analyses  which  were  run  for  the  computation  of  data  for  the  compressibility 
study  required  a large  investment  in  manpower  and  machine  time.  Therefore,  it  was  neces- 
sary to  ensure  that  the  equipment  was  in  perfect  working  order.  It  was  also  necessary  that 
a repetitive  acquisition  sequence  be  followed  for  the  procedure  to  ensure  that  all  data 
could  be  taken  under  uniform  conditions  and  that  the  resulting  data  could  be  properly 
identified.  This  section  of  the  report  describes  the  tests  to  ensure  that  the  equipment  was 
functioning  properly.  It  also  describes  the  check  points  in  the  procedure  which  assist  in 
the  monitoring  of  the  acquisition,  analysis,  and  recording  of  data. 


EQUIPMENT  VALIDATION 

The  first  concern  in  acquiring  the  data  is  to  validate  that  the  equipment  is  in  proper 
working  order  and  that  meaningful  and  repeatable  results  can  be  obtained  reliably.  The 
validation  of  the  equipment  status  is  made  by  two  types  of  tests  using  lamp  input  signals 
in  the  scanner  equipment. 

The  first  ramp  test  is  done  with  an  analog  triangular  waveform  which  is  substituted 
for  the  output  data  from  the  charge  coupled  device.  Figure  D14  shows  the  setup  for  sam- 
pling this  analog  signal.  A function  generator  module  was  fabricated  and  mounted  in  the 
module  enclosure  on  the  large  drum  test  bed.  This  circuit  produces  a triangular  waveform 
having  an  amplitude  from  0 to  - 2.56  volts.  The  upper  and  lower  excursions  of  the  wave- 
form (and  thereby  the  amplitude)  are  adjustable,  as  is  the  frequency  for  establishing  the 
limits  of  the  excursion  compatible  with  the  input  to  the  sample-and-hold  and  analog-to- 
digital  converter.  The  frequency  of  the  sawtooth  ramp  does  not  appreciably  affect  this 
experimental  result,  but  it  was  set  in  this  instance  at  about  1.25  kilohertz.  The  ramp  sweep 
is  allowed  to  run  asynchronously  with  respect  to  the  line  sampling  frequency,  which  in  this 
series  of  tests  is  approximately  9.2  lines  per  second.  The  probability  of  sampling  each  of  the 
sample  levels  from  00  to  63  should  be  equally  likely  since  excursions  of  the  sawtooth  ramp 
signals  are  quite  linear  in  both  positive  and  negative  slopes. 

The  data  from  the  A/D  converter  are  fed  through  the  image  analyzer,  which  pro- 
vides a count  of  the  number  of  times  the  A/D  converter  produces  any  and  all  of  64  differ- 
ent binary  output  states.  For  this  test  the  system  is  controlled  to  acquire  a set  of  samples 
equivalent  to  2200  lines  of  1 700  samples  ( 8 Vi-by- 1 1-inch  page  at  200  by  200  pels  per  inch), 
or  a total  of  3.74  million  samples. 

When  the  counting  process  in  the  analyzer  is  completed,  the  results  are  sent  to  the 
frame  store  memory  controller,  where  the  24-bit  binary  numbers  are  converted  to  decimal 
equivalents  and  displayed  on  the  CRT  terminal.  A hard-copy  print  can  then  be  made  of 
the  tabular  results.  Table  D2  is  an  output  showing  the  results  of  this  test.  It  can  be  seen 
that  the  number  of  samples  whose  values  were  at  level  00  through  level  63  was  approxi- 
mately the  same.  The  values  of  the  count  in  bin  01  and  02  are  slightly  different  from  the 
others,  probably  due  to  the  proximity  of  the  end  points  of  the  ramp.  Values  in  the  remain- 
ing level  bins  range  from  64  972  in  bit  04  to  34  702  in  bin  1 5. 

The  frame  store  memory  controller  also  converts  the  24  bits  of  count  data  from  the 
image  analyzer  into  bar  graph  lengths  for  presentation  on  the  Conrae  monitor  in  high- 
resolution  horizontal  histogram  form  and  on  the  Tektronix  keyboard  and  display  terminal 
in  low-resolution  vertical  histogram  form.  A copy  of  the  low-resolution  histogram  is  shown 
in  figure  D1 5. 
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Figure  D14.  Built-in  test  mode. 
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The  software  program  provides  magnification  or  normalization  of  the  image  to 
present  the  longest  high-resolution  bar  graph  display  possible  on  the  Conrac  monitor 
without  clipping  off  meaningful  data.  A copy  of  a sample  histogram  corresponding  to  the 
data  in  table  D2  is  shown  in  figure  D14(c).  This  is  done  by  testing  the  data  for  lack  of 
overflow  as  the  magnitudes  of  the  displayed  bar  lengths  are  successively  multiplied  by 
values  of  2.  Six  different  display  magnifications  can  be  presented:  2X,  4X,  8X,  16X,  and 
32X.  To  indicate  which  of  these  scales  is  being  used  for  the  display,  a series  of  dashes  is 
added  to  the  lower  right  side  of  the  display.  No  dash  represents  no  magnification;  one  dash 
indicates  that  the  scale  is  2X  and  that  all  values  indicated  by  bar  graph  should  be  multiplied 
by  2~  Two  dashes  indicate  that  all  data  should  be  multiplied  by  2"“  and  so  forth,  up  to 
five  dashes,  which  indicates  that  a factor  of  2~*  should  be  used.  On  this  latter  scale  a bar 
having  full  screen  width  represents  a quantity  of  1/32  of  the  total  count  accepted. 

The  bar  graph  is  the  sequence  of  black  lines  in  the  white  field  which  extends  from 
left  to  right  in  the  photograph.  The  space  for  bin  00  is  at  the  bottom  and  63  is  at  the  top. 
Bin  00  represents  the  blackest  signal  which  can  be  obtained  from  the  picture  and  bin  63 
the  brightest  or  whitest.  A perfect  calibration  would  show  all  bars  having  exactly  the  same 
length  and  essentially  equal  count  in  all  bins  in  the  data  of  the  table.  The  fact  that  they  are 
not  all  equal  indicates  that  there  are  differences  in  the  uniformity  of  threshold  level  of  the 
A/D  converter. 

It  should  be  noted  here  that  the  test  bed  contains  a modest  amount  of  built-in  test 
equipment  (BITE)  which  can  in  a few  seconds  verify  the  proper  operation  of  all  the  above 
process  following  the  output  of  the  A/D  converter.  This  is  accomplished  by  providing  a 
simple  binary  6-bit  counter  whose  outputs  are  substituted  for  the  A/D  converter  output  in 
the  test  mode.  The  counter  is  incremented  after  each  sample  so  that  exactly  the  same  num- 
ber of  counts  is  sent  to  the  analyzer  for  each  of  the  64  possible  values  if  the  sequence  is 
stopped  in  multiples  of  counts  divisible  by  64. 

A Xerox  copy  of  the  Polaroid  photograph  of  the  resulting  display  from  a previous 
test  using  a different  and  perhaps  more  linear  external  ramp  is  shown  in  figure  D16. 

In  our  case  we  use  27  such  sequences  of  64  per  line,  which  results  in  a total  of  1 728 
bits  per  line.  (Our  program  is  alterable  to  allow  or  prohibit  this  test  to  continue  beyond  the 
1700  pels  which  are  taken  in  a normal  image  acquisition.)  This  BITE  test  has  been  run  many 
times,  and  the  result  verifies  that  all  counts  in  the  analyzer  are  of  equal  value  and  all  bars  in 
the  display  are  of  equal  length.  It  also  verifies  that  the  total  number  of  pels  acquired  equals 
3.74  million.  By  performing  the  above  two  tests,  which  require  data  both  before  and  after 
the  A/D  converter,  and  completing  the  process  of  data  acquisition,  storage,  analysis,  and 
output  presentation,  we  can  validate  whether  or  not  the  equipment  is  functioning  in  a 
proper  and  repetitive  manner. 

Analysis  of  the  data  and  examination  of  the  bar  graph  demonstrate  in  a striking 
manner  the  cyclic  nature  of  the  residual  error  of  the  A/D  converter.  Near  the  bottom  of 
the  display  every  fourth  bin  is  longer  than  the  other  three.  In  the  center,  the  uniformity 
of  counts  in  the  bins  seems  to  improve.  Near  the  top,  the  problem  worsens  again,  but  the 
long  bar  bin  numbers  are  not  now  divisible  by  four.  At  the  bottom  they  are  04.  08.  1 2.  etc, 
and  at  the  top  they  are  63,  59,  55,51, 47,  etc. 

The  analog-to-digital  (A/D)  converter  used  to  digitize  these  4 data  is  a two-stage, 

6-bit  device.  The  first  4 bits  are  obtained  from  the  first  stage  and  the  least  two  are  obtained 
from  the  second.  Although  some  adjustments  are  available  to  establish  the  gain  and  level 
of  the  residue  from  the  first  4-bit  conversion  for  the  last  2-bit  conversion,  the  converter 
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Figure  D16.  High-resolution  test  histogram. 

appears  to  have  insufficient  internal  stability  to  maintain  a more  exact  and  uniform  rela- 
tionship for  any  appreciable  period  of  time.  Consequently,  cyclic  changes  in  length  of  the 
histogram  bars  can  be  seen  in  figure  D16. 

An  analysis  of  the  fine  structure  in  figure  D16  indicates  the  following: 

1.  The  length  of  the  shortest  bar  (above  04)  is  2.0625  inches. 

2.  The  length  of  the  longest  bar  is  3.125  inches. 

3.  The  length  of  a “standard”  bar  is  about  2.59  inches. 

4.  The  length  of  a “standard”  bar  represents  only  1/64  of  the  total  count,  or 
1.5625%. 

5.  The  total  deviation  is 

31 25  T59°62~~  X 1 -5625%  = 0.64%  . 

6.  The  deviation  of  ±0.32%  is  more  than  two  to  one  better  than  the  specified 
accuracy  of  the  converter,  which  is  ±0.781 25%. 

Although  the  instrumentation  has  not  been  designed  to  perform  with  more  accuracy 
than  ±0.78%,  or  one  part  in  64,  the  appearance  of  the  bar  graph  histogram  is  distracting  if 
not  misleading.  There  are  three  alternatives  to  the  problem.  The  first  is  to  try  to  procure 
an  A/D  converter  of  sufficiently  high  accuracy  so  that  the  unevenness  in  the  distribution 
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does  not  noticeably  exist.  This  may  require  a 10-  or  12-bit  very-high-speed  converter  which 
is  either  nonexistent  or  very  expensive. 

The  second  is  to  leave  the  hardware  and  software  unchanged  and  compensate  for  the 
unevenness  in  the  interpretation  of  the  results. 

The  third  is  to  use  a software  normalization  routine  which  will  utilize  the  calibration 
data  and  multiply  each  bin  content  by  an  appropriate  factor  to  force  the  corrected  calibra- 
tion bins  to  be  equal  at  1 /64  of  full  scale.  It  is  felt  that  this  is  the  best  approach  for  remov- 
ing the  first-order  effects  of  the  nonuniformity  for  pel  brightness  statistics.  There  can  be 
higher-order  errors  generated  by  this  process.  For  example,  if  illumination  corrected  data 
provided  a majority  of  two  brightness  level  outputs,  one  of  which  fell  exactly  in  the  center 
of  one  high  bin,  say  56,  and  the  other  exactly  in  the  center  of  a low  bin,  say  09,  then  any 
multiplication  by  correction  factors  would  lead  to  errors  in  the  ratios  of  the  resulting  pairs. 

It  is  felt  that  cases  of  this  kind  will  be  infrequent  and  that  for  data  having  statistical  charac- 
teristics such  as  we  expect  from  image  acquisition,  the  normalization  is  a meaningful 
procedure. 

The  above  two  tests  indicate  that  the  A/D  converter  is  operating  within  its  specified 
accuracy.  For  the  time  being  no  correction  is  being  made  to  the  A/D  converter  output  data. 
During  the  coming  year,  a decision  will  be  made  whether  a higher-performance  A/D  con- 
verter or  more  sophisticated  software  is  necessary  to  resolve  fine  detail  in  the  analysis.  The 
validation  process  tests  the  operation  of  the  entire  test  bed  with  the  exception  of  the  imager 
and  its  preamplifier.  This  includes  all  modes  of  the  analyzer,  two  tape  decks,  controller, 
software,  and  hard-copy  printer.  When  all  this  is  seen  to  operate  properly,  it  is  possible  to 
calibrate  the  illumination  levels. 


CALIBRATION 

The  first  test  to  be  made  in  the  calibration  procedure  is  to  check  the  response  from 
the  A/D  converter  with  the  white  and  the  black  standards  placed  in  the  optical  path  of  the 
imager. 

The  white  standard  is  obtained  by  painting  Eastman  white  reflectance  standard 
(catalog  6091 ) on  a curved  metallic  plate  which  can  be  rotated  in  front  of  the  illuminated 
area  on  the  drum.  The  white  reflectance  standard  is  specially  purified  barium  sulfate,  which 
gives  a very  fine  diffuse  reflectance  of  radiant  energy  from  about  200  nanometres  in  the 
ultraviolet  region  to  about  2500  nanometres  in  the  near  infrared  region.  The  black  standard 
is  a black  felt  material  approximately  1 inch  wide  and  extending  across  the  entire  drum 
width.  This  material,  which  is  obtained  from  Edmond  Scientific  Co,  provides  less  reflectance 
than  any  other  convenient  material  we  have  yet  measured. 

With  the  white  standard  in  place,  the  imager  amplifier  is  adjusted  in  gain  and  level  to 
provide  a digital  output  of  binary  63.  Another  adjustment  is  used  to  produce  a binary  00 
output  from  the  A/D  converter  when  the  black  standard  is  scanned. 

It  should  be  noted  here  that  these  calibration  tests  are  made  with  the  two  broad- 
spectrum  fluorescent  lamps  at  their  nominal  operating  voltage  and  that  no  filters  are  placed 
over  the  lens  so  that  the  data  represent  the  black  and  white  response  of  the  system.  For 
these  tests  an  f3.5  Micro  Auto  Nikkor  P55-mm  lens  is  used  for  the  acquisition.  For  the 
extremes  of  illumination  presented  by  the  white  standard  and  the  black  felt  black  standard, 
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when  copy  samples  of  low  reflectance  are  used  in  the  analysis  process.  In  these  cases  the 
lens  aperture  can  be  opened  to  as  much  as  the  full  aperture  of  0.5  without  serious 
degradation  of  image  quality. 

IMAGE  ACQUISITION  RATE 

The  image  acquisition  for  these  tests  is  made  with  the  Fairchild  CCD-121,  which  is 
a 1 728-pel  device  having  a maximum  output  frequency  of  1 .0  megahertz. 

Because  of  the  limited  capacity  of  our  solid-state  memory,  it  is  necessary  to  store 
the  complete  page  images  onto  nine-track  magnetic  tapes  mounted  on  the  Kennedy  tape 
deck.  The  storage  input  rate  onto  the  Kennedy  tape  seriously  slows  the  system  acquisition 
rate  even  though  it  is  running  at  1600  bytes  per  inch  and  45  inches  per  second.  The  tape 
storage  of  the  data  cannot  be  exactly  synchronized  with  respect  to  the  line  advance  signal 
which  is  received  from  the  Baldwin  encoder  mounted  on  the  scanning  drum.  The  0.005- 
inch  incremental  signal  supplied  by  the  Baldwin  encoder  must  occur  with  a frequency  which 
is  equal  to  or  less  than  the  input  line  rate  of  data  onto  the  magnetic  tape. 

Therefore,  the  data  for  full-page  images  are  taken  very  slowly.  It  was  decided  that 
for  this  portion  of  the  evaluation,  it  would  be  undesirable  to  change  imager  clock  frequen- 
cies, imager  integration  time,  or  drum  speed.  The  only  variable  which  was  allowed  was 
the  f stop  on  the  lens.  From  preliminary  tests,  it  was  determined  that  the  response  of  the 
imager  when  used  with  any  of  the  three  Filters  was  approximately  25%  of  the  output  ob- 
tained with  broadband  illumination.  Thus,  an  allowance  in  initial  lens  setting  of  two  f stops 
was  required.  In  order  to  accommodate  low-reflectance  materials  with  a filter,  a latitude  of 
two  more  f stops  was  desirable. 

Our  lens  is  an  f3.5  55-mm  Micro  Auto  Nikkor.  If  we  chose  f4  for  low-reflectance 
tests  with  filters,  then  normal  reflectance  with  filters  will  be  accommodated  at  f8,  and  f 1 6 
will  accommodate  normal  reflectance  with  no  filters.  The  stop  at  f 1 6 will  also  be  used  for 
calibrating  the  system  with  the  white  standard.  We  tried  to  maintain  a constant  illumina- 
tion level  for  all  tests.  This  was  found  to  be  undesirable  from  the  standpoint  of  fine 
adjustment  and  the  restriction  was  dropped. 

Once  the  stop  at  f 1 6 is  chosen,  the  integration  time  for  acquiring  a maximum 
brightness  reflection  from  the  white  standard  can  be  chosen.  The  integration  time  must  be 
set  so  that  the  imager  output  voltage  remains  slightly  below  saturation  when  viewing  the 
standard. 

The  CCD1 21  imaging  device  has  no  control  to  inhibit  integration  during  the  expo- 
sure period.  The  0.005-inch  marks  from  the  Baldwin  encoder  cannot  be  used  because  their 
time  periods  vary  about  ±25%.  This  would  cause  an  erroneous  interpretation  of  image 
brightness  if  this  variation  were  allowed.  For  this  reason  it  is  necessary  to  provide  repeti- 
tive output  sequences  from  the  imager.  By  experiment,  it  was  determined  that  one  line 
scan  time  should  be  1 5.2  milliseconds.  This  requires  a scanner  clock  frequency  of  1 1 5.8 
kHz  for  the  1 763  pulses  (35  are  extra  for  purging  and  setup)  of  the  imager. 

We  have  now  given  a reason  for  the  tape  deck  and  the  imager  to  run  asynchronously. 
There  is  still  another  portion  of  the  system  whose  timing  must  be  considered.  This  is  the 
rate  at  which  the  0.005-inch  Baldwin  encoder  pulses  occur.  As  mentioned  previously,  they 
may  not  occur  at  a more  rapid  rate  than  data  can  be  acquired  by  the  tape  deck.  The 
process  of  loading  the  tape  can  be  divided  into  three  parts.  The  first  sequence  is  the  trans- 
mission and  storage  of  the  1 728  6-bit  pel  words  from  the  large  drum  test  bed  (LDTB)  into 
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the  solid-state  frame  store  memory.  Once  the  data  are  in  the  memory,  the  data  for  the 
line  are  fed  to  the  tape,  one  6-bit  word  at  a time,  until  all  1 728  words  for  the  line  are  stored 
along  with  a line  number.  An  interrecord  gap  is  then  left  on  the  tape  to  ensure  line  identity. 
This  total  three-part  sequence  requires  about  50  milliseconds  per  line.  This  would  allow  20 
lines  per  second  to  be  captured.  Because  of  the  jitter  in  the  time  between  0.005-inch  line 
feed  pulses,  the  drum  was  slowed  to  about  half  the  maximum  rate.  With  the  belt  and 
pulleys  now  on  the  drum,  the  line  pulse  rate  is  about  9.2  lines  per  second. 

The  effects  of  the  synchronism  with  respect  to  the  irregularity  of  images  acquired 
must  be  examined.  There  must  be  a delay  in  acquiring  a line  unless  the  line  feed  pulse  and 
the  scanner  start  a line  capture  in  the  middle  of  a line.  For  this  reason,  the  equipment  is 
logically  wired  to  accept  the  first  complete  line  which  begins  after  a line  feed  pulse.  Since 
there  are  about  seven  sweeps  of  the  imager  between  0.005-inch  line  feed  pulses,  the  maxi- 
mum variation  in  position  of  a line  scan  is  one-seventh  of  0.005  inch  or  about  0.0007  inch. 
This  is  felt  to  be  satisfactory  for  these  tests.  In  real -time  operation,  of  course,  the  line  feed 
pulses  will  trigger  the  scanning  mechanism. 
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DATA  ANALYSIS 


PEL  BRIGHTNESS  STATISTICS 

In  the  context  of  data  compressibility,  the  pel  brightness  statistics  are  examined  for 
the  properties  that  differentiate  black  and  white  typed  or  handwritten  pages  from  continu- 
ous tone  photographs.  Once  this  is  determined,  different  compression  algorithms  may  be 
implemented.  For  example,  typewritten  pages  may  be  encoded  with  1 bit  per  pel  after 
examining  the  pel  brightness  statistics  to  determine  the  optimum  threshold. 

Pel  brightness  statistics  for  several  of  the  images  analyzed  are  presented  in  figures 
D17  through  D21.  Also,  the  pel  brightness  statistics  in  tabular  form  for  all  the  images 
tested  are  given  in  appendix  A (to  this  appendix).  Figure  D1 7 shows  the  brightness  dis- 
tribution for  a piece  of  white  paper  with  no  information  on  it.  A majority  of  the  intensity 
levels  fall  within  a very  narrow  range,  about  level  49,  and  there  are  very  few  pels  at  the 
other  intensity  levels.  Figure  D18  shows  the  brightness  statistics  for  a typed  page.  Here  can 
be  seen  the  two-peaked  curve  as  predicted  in  figure  D7.  The  figure  shows  that  the  type- 
written information  centered  about  level  24  occupies  only  about  4%  of  the  entire  image. 
Figure  D19  is  another  example  of  a typed  page  showing  the  same  general  characteristics  of 
the  previous  one.  In  contrast  to  the  typed  page,  figure  D20  shows  the  brightness  statistics 
for  a continuous  tone  photograph  containing  a large  number  of  intensity  levels  throughout 
the  entire  brightness  range.  There  is  no  longer  the  two-peaked  characteristic  of  the  typed 
pages.  However,  any  algorithms  developed  must  be  clever  enough  so  as  not  to  be  fooled 
by  dips  such  as  those  around  level  16  or  22  in  this  figure. 
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Figure  D21  contains  the  brightness  statistics  for  the  IEEE  facsimile  chart,  which 
contains  both  types  of  information,  typed  and  continuous  tone.  Here  can  be  seen  two 
peaks  corresponding  to  background  and  printed  information  much  the  same  as  in  the  type- 
written page.  However,  a portion  of  this  chart  does  contain  a continuous  tone  photograph, 
which  may  cause  an  error  in  the  algorithm  which  differentiates  between  continuous  tone 
photographs  and  typed  or  handwritten  information. 

One  of  the  purposes  of  this  program  is  to  investigate  computer  algorithms  to  auto- 
matically determine  image  type;  that  is,  whether  an  image  is  (1 ) typed  or  handwritten 
material,  or  (2)  a continuous  tone  photograph.  This  decision  may  then  be  used  to  initiate 
among  other  system  controls  an  appropriate  compression  scheme  such  as  run  length  coding 
or  differential  pulse  code  modulation  (DPCM)  for  a 6-bit  continuous  tone  image,  or  a 
scheme  such  as  run  length  coding  for  a 1-bit  typewritten  or  handwritten  image. 

FIRST  DERIVATIVE  STATISTICS 

One  of  the  goals  of  this  program  is  to  examine  differential  pulse  code  modulation 
(DPCM)  techniques  for  compression  of  these  data.  To  do  this,  the  first  derivative  statistics 
were  accumulated  for  several  images.  Examination  of  these  statistics  showed  a problem 
which  must  be  corrected  before  proceeding  with  the  DPCM  studies.  This  problem  is  the 
modulation  transfer  function  (MTF)  of  the  large  drum  test  bed  system.  A major  problem 
is  believed  to  be  the  MTF  of  the  lens  used  for  imaging. 

Two  examples  of  the  first  derivative  statistics  are  shown  in  figures  D22  and  D23. 
These  figures  both  show  a predominance  of  changes  of  either  0 or  1 level,  indicating  little 
or  no  change  in  the  brightness  of  the  image.  Where  the  data  do  change,  the  magnitude  of 
change  averages  from  6 to  1 2 levels,  as  shown  by  the  flat  portions  of  the  two  curves. 
Referring  back  to  the  pel  brightness  statistics  for  these  two  images  in  figures  D1 8 and  D21 , 
the  two  predominant  brightness  levels  for  the  background  and  the  print  are  separated  by 
approximately  32  brightness  levels.  Therefore,  the  first  derivative  statistics  should  contain 
some  differences  on  the  order  of  30  brightness  levels.  The  fact  that  this  does  not  occur 
implies  that  there  is  a slew  rate  limitation  in  the  system  probably  due  to  the  MTF  roll-off 
in  the  lens. 

The  first  derivative  statistics  in  tabular  form  and  in  low-resolution  histogram  form 
for  the  test  images  are  given  in  appendix  B (to  this  appendix). 

RUN  LENGTH  STATISTICS 

Since  the  run  length  statistics  are  comprised  of  24  separate  tables  for  each  image, 
a complete  set  of  statistics  will  be  sent  under  separate  cover  to  the  USPS.  In  appendix  C 
there  are  two  sets  of  run  length  statistics  for  a typed  page  and  the  IEEE  facsimile  chart.  To 
summarize  these  data,  a computer  program  was  generated  to  calculate  compression  ratios 
on  these  data  for  several  different  run  length  encoding  algorithms.  These  algorithms  are 
summarized  in  tables  D3  through  D6.  The  first  is  a 6-3  fixed  length  algorithm  designed  to 
efficiently  compress  images  containing  a predominantly  white  background  with  smaller 
areas  of  black  information.  To  do  this,  a 6-bit  fixed  length  code  is  used  to  encode  the  runs 
of  ones  (white),  which  are  in  general  longer  than  runs  of  zeros  (black).  The  algorithm  uses 
a 3-bit  fixed  length  code  to  encode  the  shorter  runs  of  zeros.  Table  D4  shows  a 4-bit  fixed 
length  code  which  encodes  both  runs  of  ones  and  zeros  with  the  same  code.  Table  D5  shows 
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TABLE  D3.  A 6-3  FIXED  WORD  LENGTH  RLC  CODE. 

Black  Runs  White  Runs 

Run  Length  Code  Run  Length  Code 


1 

0 

0 

0 

1 

0 

0 0 0 

0 

0 

2 

0 

0 

1 

2 

0 

0 0 0 

0 

1 

3 

0 

1 

0 

3 

0 

0 0 0 

1 

0 

4 

0 

1 

1 

4 

0 

0 0 0 

1 

1 

5 

1 

0 

0 

5 

0 

0 0 1 

0 

0 

6 

1 

0 

1 

• 

• 

>6 

1 

1 

0 

• 

• 

7 

1 

1 

0 

0 

0 

0 

• 

• 

8 

1 

1 

0 

0 

0 

1 

60 

1 

1 

0 

1 

1 

9 

1 

1 

0 

0 

1 

0 

61 

1 

1 

1 

0 

0 

10 

1 

1 

0 

0 

1 

1 

62 

1 

1 

1 

0 

1 

• 

>62 

1 

1 

1 

1 

0 

• 

63 

1 

1 

1 

1 

0 

0 

0 

• 

64 

1 

1 

1 

1 

0 

0 

0 

65 

1 

1 

1 

1 

0 

0 

0 

1 1 1 1 1 1 1 1 - SYNC 

TABLE  D4.  4-BIT  FIXED  WORD  LENGTH  RLC  CODE. 
Run  Length  Code 


1 

2 

3 

4 


0 0 0 0 
0 0 0 1 
0 0 10 
0 0 11 


13 

1 1 0 

0 

14 

1 1 0 

1 

15 

1 1 1 

0 

>15 

1 1 1 

1 

16 

1 1 1 

1 

0 

0 

0 

0 

17 

1 1 1 

1 

0 

0 

0 

1 

18 

1 1 1 

1 

0 

0 

1 

0 
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TABLE  D5.  VARIABLE  WORD  LENGTH  RLC  CODE  WITH  3-BIT  MINIMUM  LENGTH  CODE. 

Code 

Run 

Word 

Length 

Length 

(elements) 

Address 

Remainder 

(bits) 

1 

0 

00 

3 

0 

01 

3 

3 

0 

10 

3 

4 

0 

11 

3 

5 

10 

00 

4 

6 

10 

01 

4 

7 

10 

10 

4 

8 

10 

11 

4 

9 

110 

000 

6 

10 

110 

001 

6 

16 

110 

111 

6 

17 

1110 

0000 

8 

18 

1110 

0001 

8 

32 

1110 

ini 

8 

33 

11110 

00000 

10 

64 

11110 

mu 

10 

65 

111110 

000000 

12 

128 

111110 

min 

12 

129 

1111110 

0000000 

14 

256 

1111110 

mini 

14 

257 

11111110 

00000000 

16 

512 

11111110 

11111111 

16 

Margin  Code 

111111110 

K ^ 
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a variable  length  coding  scheme  that  begins  with  a 3-bit  code  for  the  shortest  runs,  and 
table  D6  shows  another  variable  length  code  beginning  with  a 2-bit  sequence.  The  variable 
length  codes  in  general  give  higher  compression  ratios  at  the  expense  of  more  costly 
hardware. 

The  compression  ratios  presented  in  this  section  should  not  be  considered  as  abso- 
lute values  to  be  obtained  when  implementing  the  specific  algorithms  specified  here.  There 
are  two  reasons  for  this.  First,  the  computation  of  the  compression  ratio  does  not  include 
any  overhead  line  sync  codes  or  header  codes.  A minimum  length  line  sync  code  could  be 
defined  for  the  variable  length  run  length  code  (RLC)  algorithms;  however,  no  such  mini- 
mum code  may  be  defined  for  the  fixed  length  RLC  algorithms.  Therefore,  an  estimate 
cannot  be  made  of  the  total  number  of  overhead  bits  used  to  transmit  an  image.  A true 
compression  ratio  must  take  into  account  all  the  overhead  bits  required  for  transmission. 
Thus,  these  numbers  should  be  considered  only  for  their  relative  values. 

Second,  since  the  digital  image  analyzer  has  a capability  to  store  only  64  running 
totals,  runs  of  lengths  greater  than  64  must  be  broken  up  into  several  groups.  This  offers 
no  problem  for  the  fixed  length  code  presented  here,  but  it  does  limit  the  effective  com- 
pression ratio  for  variable  length  RLC  codes.  Table  D6  shows  a variable  word  length  RLC 
dictionary  for  that  code  starting  with  a 2-bit  word  length.  Depending  on  the  particular 
application,  an  RLC  encoder  may  be  designed  to  encode  runs  up  to  a certain  length  less 
than  4094  shown  in  the  table.  If  the  encoder  was  designed  to  encode  runs  of  not  greater 
than  64,  the  results  presented  in  this  report  would  be  an  accurate  indication  of  the  com- 
pression obtained.  However,  the  images  analyzed  here  contain  1700  pels  per  line.  There- 
fore, a run  length  can  be  as  long  as  1 700  pels.  In  the  most  significant  bit  place,  for  example, 
approximately  half  the  lines  are  all  ones,  given  an  image  of  a typed  page.  Using  the  variable 
word  length  RLC  code  from  table  D6,  a run  of  1 700  pels  can  be  encoded  with  a 20-bit  code. 
The  digital  image  analyzer  breaks  this  run  into  26  runs  of  length  64  and  one  run  of  length 
36.  Using  the  same  code  table  these  runs  are  encoded  using  a total  of  322  bits,  instead  of 
20.  Therefore,  the  figures  presented  in  this  report  should  be  used  only  to  compare  the 
relative  efficiencies  of  the  various  run  length  compression  codes. 

A comparison  of  the  compression  ratios  calculated  for  all  the  run  length  algorithms 
is  shown  in  table  D7  for  the  images  tested.  The  compression  ratios  were  calculated  for  both 
binary  and  Gray  code  image  data.  These  compression  ratios  are  computed  on  all  6-bit 
planes  taken  1 bit  plane  at  a time  for  each  image.  It  is  seen  here  that  in  general  the  com- 
pression ratios  are  very  low  and  for  the  fixed  length  codes,  in  some  cases,  there  is  even  an 
expansion  of  data  rather  than  a compression.  The  main  reason  for  this  is  the  large  number 
of  very  short  runs  in  the  lower-order  bit  planes.  These  figures  also  demonstrate  approxi- 
mately a 30%  improvement  in  compression  ratio  when  using  Gray  code  instead  of  binary. 
Still  another  observation  is  that  for  the  typed  page  1T3  the  illumination  correction  proce- 
dure does  improve  the  compressibility  of  the  image. 

For  each  of  the  four  RLC  algorithms  examined,  a comparison  of  the  compression 
ratios  for  all  the  images  is  shown  in  tables  D8  through  Dll.  Since  there  are  many  very 
short  runs  in  the  low-order  bit  planes,  compression  ratios  were  computed  for  the  images 
assuming  a 5-bit  precision  and  also  for  a 1-bit  image.  As  can  be  seen  in  the  table,  there  is 
only  a slight  improvement  in  the  compressibility  with  5-bit  planes  instead  of  6.  However 
with  only  the  most  significant  bit  plane  there  is  a rather  large  improvement  in  the  com- 
pression ratios  shown. 
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TABLE  D6.  VARIABLE  WORD  LENGTH  RLC  CODE  WITH  2-BIT  MINIMUM  LENGTH  CODE. 


Run 

Length 

(elements) 


Code  Word 


Address 


Remainder 


Code 

Word 

Length 


3 

4 

5 

r. 


10 

10 

10 

10 


00 

01 

10 

11 


110 


110 


000 


111 


15 


30 


1110 


1110 


0000 


1111 


31 


02 


11110 


11110 


00000 


11111 


10 


10 


03 


111110 


000000 


120 

111110 

111111 

12 

127 

1111 110 

0000000 

• 

14 

254 

1111110 

• 

1111111 

14 

255 

11111110 

00000000 

• 

16 

510 

11111110 

• 

11111111 

16 

511 

• 

111111110 

• 

000000000 

• 

18 

• 

1022 

• 

111111110 

• 

111111111 

18 

1023 

1111111110 

0000000000 

• 

• 

2040 

• 

• 

1111111110 

1111111111 

• 

• 

20 

2047 

11111111110 

• 

00000000000 

22 

• 

4094 

• 

11111111110 

11111111111 

• 

22 

MC 

11111111111 

lllllllllOP 

22 

TABLE  D7.  COMPRESSION  RATIO  SUMMARY. 


RUN  LENGTH  ALGORITHM 


Image  Tape 
Number 

6-3  Fixed 
binary  Gray 

4-bit  Fixed 
binary  Gray 

3-bit  Variable 
binary  Gray 

2-bit  Variable 
binary  Gray 

IT2 

1.00 

1.37 

1.85 

1.53 

1.56 

2.02 

1.70 

2.10 

•IT3 

0.66 

0.85 

0.85 

1.02 

1.10 

1.36 

1.30 

1.58 

IT3 

0.85 

1.23 

1.05 

1.48 

1.36 

1.92 

1.51 

2.05 

IT4 

0.93 

1.31 

1.12 

1.47 

1.46 

1.96 

1.60 

2.08 

IT5 

0.80 

1.25 

1.00 

1.42 

1.28 

1.89 

1.44 

2.02 

IT6 

0.89 

1.27 

1.08 

1.44 

1.40 

1.89 

1.54 

2.00 

IT7 

0.73 

1.12 

0.91 

1.27 

1.20 

1.73 

1.45 

1.98 

IT8 

1.15 

1.56 

1.28 

1.65 

1.76 

2.31 

1.93 

2.41 

IT9 

0.76 

1.03 

0.96 

1.23 

1.24 

1.60 

1.41 

1.76 

IT10 

0.94 

1.38 

1.02 

1.51 

1.47 

2.05 

1.64 

2.19 

IT1 1 

0.71 

1.00 

0.90 

1.18 

1.16 

1.56 

1.35 

1.76 

IT12 

0.88 

1.24 

1.07 

1.41 

1.37 

1.83 

1.53 

1.95 

IT13 

— 

0.84 

1.23 

1.02 

1.37 

1.33 

1.82 

1.52 

1.98 

♦Not  illumination  corrected 


TABLE  D8.  6-3  FIXED  LENGTH  RLC  ALGORITHM  COMPRESSION  RATIOS. 


Binaiy  Code 

6-bit 

Planes 

5-bit 

Planes 

MSB 

Plane 

IT2 

Typed  page  thresholded 

1.00 

1.27 

3.47 

IT3 

Typed  page  white 

0.85 

1.02 

3.53 

IT4 

Typed  page  green 

0.93 

1.15 

3.51 

IT5 

Typed  page  red 

0.80 

0.94 

3.50 

IT6 

Typed  page  blue 

0.89 

1.08 

3.51 

IT7 

Drum  photo 

0.73 

0.84 

5.35 

IT8 

White  paper 

1.15 

1.61 

5.25 

IT9 

IEEE  fax  chart 

0.76 

0.87 

2.49 

IT10 

USPS  Announcement  77 1 

0.94 

1.17 

3.80 

IT1 1 

USPS  facility  photo 

0.71 

0.79 

2.38 

IT12 

Versatec  sample  print 

0.88 

1.06 

3.04 

IT13 

Drum  photo  thresholded 

0.84 

1.02 

4.27 

Gray  Code 


IT2 

Typed  page  thresholded 

1.37 

1.68 

3.47 

IT3 

Typed  page  white 

1.28 

1.60 

3.53 

IT4 

Typed  page  green 

1.31 

1.60 

3.51 

IT5 

Typed  page  red 

1.25 

1.51 

3.50 

IT6 

Typed  page  blue 

1.27 

1.55 

3.51 

IT7 

Drum  photo 

1.12 

1.43 

5.35 

IT8 

White  paper 

1.56 

1.75 

5.25 

IT9 

IEEE  fax  chart 

1.03 

1.20 

2.49 

IT10 

USPS  Announcement  77 1 

1.38 

1.66 

3.80 

IT11 

USPS  facility  photo 

1.00 

1.20 

2.38 

IT12 

Versatec  sample  print 

1.24 

1.50 

3.04 

IT13 

Drum  photo  thresholded 

1.23 

1.59 

4.27 

TABLE  D9.  4-BIT  FIXED  LENGTH  RLC  ALGORITHM  COMPRESSION  RATIOS. 


Binary  Code 

6-bit 

Planes 

5-bit 

Planes 

MSB 

Pane 

IT2 

Typed  page  thresholded 

1.18 

1.53 

2.75 

IT3 

Typed  page  white 

1.04 

1.30 

2.79 

IT4 

Typed  page  green 

1.12 

1.42 

2.88 

IT5 

Typed  page  red 

1.00 

1.22 

2.79 

IT6 

Typed  page  blue 

1.08 

1.36 

2.79 

IT7 

Drum  photo 

0.91 

1.09 

3.20 

IT8 

White  paper 

1.28 

1.77 

3.17 

IT9 

IEEE  fax  chart 

0.96 

1.14 

2.33 

ITIO 

USPS  Announcement  771 

1.12 

1.43 

2.86 

IT1 1 

USPS  facility  photo 

0.99 

1.05 

2.22 

ITI2 

Versatec  sample  print 

1.07 

1.33 

2.61 

IT13 

Drum  photo  thresholded 

1.02 

1.29 

2.95 

Gray  Code 


IT2 

Typed  page  thresholded 

1.53 

1.85 

2.75 

IT  3 

Typed  page  white 

1.45 

1.77 

2.79 

IT4 

Typed  page  green 

1.47 

1.77 

2.88 

IT5 

Typed  page  red 

1.42 

1.71 

2.79 

IT6 

Typed  page  blue 

1.44 

1.75 

2.79 

IT7 

Drum  photo 

1.27 

1.60 

3.20 

IT8 

White  paper 

1.65 

1.86 

3.17 

IT9 

IEEE  fax  chart 

1.23 

1.44 

2.33 

IT10 

USPS  Announcement  771 

1.51 

1.81 

2.86 

ITU 

USPS  facility  photo 

1.18 

1.43 

2.22 

IT12 

Versatec  sample  print 

1.41 

1.71 

2.61 

IT13 

Drum  photo  thresholded 

1.37 

1.75 

2.95 

TABLE  DiO.  3-BIT  VARIABLE  LENGTH  RLC  ALGORITHM  COMPRESSION  RATIOS. 


6-bit 

5-bit 

MSB 

Binary  Code 

Planes 

Planes 

Plane 

IT2 

Typed  page  thresholded 

1.56 

2.04 

4.32 

IT3 

Typed  page  white 

1.36 

1.70 

4.35 

1T4 

Typed  page  green 

1.46 

1.87 

4.33 

ITS 

Typed  page  red 

1.28 

1.57 

4.32 

IT6 

Typed  page  blue 

1.40 

1.78 

4.33 

IT7 

Drum  photo 

1.20 

1.46 

6.30 

IT8 

White  paper 

1.76 

2.56 

6.23 

IT9 

IEEE  fax  chart 

1.24 

1.48 

3.25 

IT10 

USPS  Announcement  771 

1.47 

1.90 

4.70 

IT1 1 

USPS  facility  photo 

1.16 

1.36 

3.30 

IT12 

Versatec  sample  print 

1.37 

1.70 

3.76 

ITI3 

Drum  photo  thresholded 

1.33 

1.68 

5.10 

Gray  Code 

IT2 

Typed  page  thresholded 

2.02 

2.52 

4.32 

IT3 

Typed  page  white 

1.92 

2.44 

4.35 

IT4 

Typed  page  green 

1.96 

2.46 

4.33 

ITS 

Typed  page  red 

1.89 

2.37 

4.32 

IT6 

Typed  page  blue 

1.89 

2.36 

4.33 

IT7 

Drum  photo 

1.73 

2.27 

6.30 

IT8 

White  paper 

2.31 

2.77 

6.23 

IT9 

IEEE  fax  chart 

1.60 

1.92 

3.25 

IT10 

USPS  Announcement  77 1 

2.05 

2.56 

4.70 

IT1 1 

USPS  facility  photo 

1.56 

1.94 

3.30 

IT12 

Versatec  sample  print 

1.83 

2.28 

3.76 

IT13 

Drum  photo  thresholded 

1.82 

2.39 

5.10 
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TABLE  D1 1 . 2-BIT  VARIABLE  LENGTH  RLC  ALGORITHM  COMPRESSION  RATIOS. 


Binary  Code 

6-bit 

Planes 

5-bit 

Planes 

MSB 

Plane 

IT2 

Typed  page  thresholded 

1.70 

2.13 

3.87 

IT3 

Typed  page  white 

1.51 

1.82 

3.77 

IT4 

Typed  page  green 

1.60 

1.96 

3.74 

ITS 

Typed  page  red 

1.44 

1.71 

3.72 

IT6 

Typed  page  blue 

1.54 

1.87 

3.74 

IT7 

Drum  photo 

1.45 

1.72 

5.28 

IT8 

White  paper 

1.93 

2.64 

5.22 

IT9 

IEEE  fax  chart 

1.41 

1.64 

2.98 

IT10 

USPS  Announcement  771 

1.64 

2.04 

4.11 

IT1 1 

USPS  facility  photo 

1.35 

1.56 

3.29 

IT12 

Versatec  sample  print 

1.52 

1.84 

3.46 

IT13 

Drum  photo  thresholded 

1.52 

1.84 

4.51 

Gray  Code 


IT2 

Typed  page  thresholded 

2.10 

2.53 

3.87 

IT3 

Typed  page  white 

2.05 

2.49 

3.77 

IT4 

Typed  page  green 

2.08 

2.51 

3.74 

IT5 

Typed  page  red 

2.02 

2.44 

3.72 

IT6 

Typed  page  blue 

2.00 

2.41 

3.74 

IT7 

Drum  photo 

1.98 

2.50 

5.28 

IT8 

White  paper 

2.41 

2.81 

5.22 

IT9 

IEEE  fax  chart 

1.76 

2.03 

2.98 

IT10 

USPS  Announcement  771 

2.19 

2.63 

4.11 

IT1 1 

USPS  facility  photo 

1.76 

2.13 

3.29 

IT12 

Versatec  sample  print 

1.95 

2.36 

3.46 

IT13 

Drum  photo  thresholded 

1.98 

2.49 

4.51 

RESULTS  AND  CONCLUSIONS 
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1.  Three  types  of  statistics  were  obtained  from  13  image  data  files  - pel  brightness 
statistics,  first  derivative  statistics,  and  run  length  statistics.  These  statistics  are  presented  in 
tabular  form  for  selected  images  in  appendices  A,  B,  and  C. 

2.  The  pel  brightness  statistics  show  overall  similarities  for  two  distinct  image  types 
- typewritten  pages  and  continuous  photographs.  The  possibility  does  exist  that  an  algo- 
rithm can  be  generated  to  differentiate  between  these  image  types. 

3.  The  first  derivative  statistics  brought  to  the  surface  a problem  associated  with  the 
large  drum  test  bed.  This  problem  resulted  in  a lack  of  pel-to-pel  differences  of  an  expected 
magnitude,  that  magnitude  being  the  difference  between  the  average  white  level  and  the 
average  black  level  in  an  image.  It  is  believed  that  the  imaging  lens  has  too  low  a modulation 
transfer  function  (MTF)  for  imaging  at  200  by  200  pels  per  inch. 

4.  The  run  length  statistics  show  a very  large  number  of  very  short  runs  in  the  lower 
bit  planes,  resulting  in  relatively  low  compression  ratios.  A large  part  of  this  is  caused  by 

an  unbalanced  condition  in  the  two  analog  transport  registers  in  the  CCD-121  imager.  A 
newly  designed  imager,  CCD-121H,  is  supposed  to  eliminate  this  problem.  However,  the 
compression  ratios  presented  in  this  report  do  indicate  several  things: 

a.  Variable  length  RLC  algorithms  exhibit  higher  compression  ratios  than  fixed 
length  codes. 

b.  For  the  fixed  length  codes  the  4-bit  algorithm  unexpectedly  showed  slightly 
higher  compression  ratios  than  the  6-3  fixed  algorithm.  This  is  believed  to  be 
due  to  the  large  number  of  very  short  runs.  For  the  most  significant  bit  plane 
only,  representing  a 1-bit  image,  the  6-3  fixed  length  algorithm  is  about  20% 
better. 

c.  For  the  variable  length  codes  the  2-bit  code  - ie,  the  code  which  begins  with 
a 2-bit  minimum  length  code  word  - shows  slightly  higher  compression  ratios 
for  all  6-bit  planes.  However,  for  only  the  most  significant  bit  plane  the 
opposite  is  true.  Again,  this  is  due  to  the  large  number  of  short  runs  in  the 
lower  bit  planes. 

d.  Converting  the  image  data  from  binary  to  Gray  code  produces  about  a 30% 
increase  in  compression  ratios  from  all  the  algorithms. 
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PLANNED  FUTURE  NELC  ACTIVITIES 

1.  The  newly  designed  CCD-121HC  (1728  element)  and  the  CCD-1 31  DC  (1024 
element)  imaging  devices  will  be  integrated  into  the  large  drum  test  bed  for  future  image 
acquisition  and  analysis. 

2.  If  one  can  be  obtained,  a new  imaging  lens  with  a higher  modulation  transfer 
function  (MTF)  will  be  installed  on  the  large  drum  test  bed. 

3.  To  obtain  a more  accurate  representation  of  compressibility  using  the  variable 
length  RLC  algorithms,  a software  program  or  hardware  modification  should  be  generated 
so  that  runs  longer  than  64  bits  (up  to  1 728  bits)  can  be  detected  and  tallied. 

4.  The  applicability  of  differential  pulse  code  modulation  (DPCM)  compression 
techniques  to  USPS  images  will  be  studied. 

5.  Novel  compression  techniques  such  as  block  void  coding  and  special  run  length 
routines  will  be  investigated. 
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This  report  is  the  last  in  a series  of  six  summary  reports  due  in  FY76.  The  sub- 
ject covered  is  image  enhancement.  The  year’s  efforts  in  this  area  were  expended  in 
three  types  of  enhancement-edge  enhancement,  color  filtering,  and  video  compression. 
A discussion  of  the  three  types  and  example  images  showing  the  results  are  presented  in 
the  body  of  the  report. 


EDGE  ENHANCEMENT 

Edge  enhancement  is  a technique  used  in  television  presentations.  It  is  used  to 
accentuate  the  perimeters  of  block  letters  used  in  titles,  advertisements,  and  messages 
presented  on  the  screen.  This  is  accomplished  by  employing  two-dimensional  filtering 
to  the  message  frame.  Some  discussion  and  a tentative  two-dimensional  algorithm  were 
included  in  the  first  annual  report*  on  the  program.  Due  to  other  commitments  employ- 
ing the  test  bed,  the  algorithm  was  not  tested  until  recently. 

The  derivation  of  the  equation  for  edge  enhancement  in  one  dimension  is  given 
in  appendix  A (to  this  appendix).  A nonrecursive  filter  was  used  for  the  principal 
investigation  in  order  to  preserve  symmetry  of  the  effect  on  both  leading  and  trailing 
edges  of  the  enhanced  area.  The  equation  for  the  simplest  filter,  and  one  which  can 
be  fabricated  in  hardware  form  to  operate  in  real  time  at  21  megapels  per  second  is 
as  follows: 


_^o  = -Kj  Z2  + (l  + 2Kj ) Z - Kj 


where  Kj  is  a positive  fractional  constant  which  can  be  chosen  to  vary  the  amplitude 
of  the  enhancement  effect. 

This  equation  was  used  to  formulate  the  two-dimensional  equivalent  which 
follows: 


Si 

S2 

S3 

s4 

c 

s5 

s6 

s7 

s8 

C = brightness  amplitude  of  center  pel 
Sj-Sg  = brightness  amplitude  of  surrounding  pels 

Output,  CE  = C (2K  + 1 ) - K (S  highest  + S lowest) 
Unless  C S every  member  of  the  set  Sn,  in  which  case 


let  CE  — C 


This  chosen  algorithm  does  not  exactly  search  the  four  linear  profiles  which  are: 
(1)  Sj  C Sg;  (2)  S2  C S7;  (3)  S3  C S^;  (4)  S5  C S4.  The  steepest  profile  should  be 
identified  and  the  linear  algorithm  should  be  used  to  process  this  profile  to  find  a value 
CE  for  the  center  pel.  In  view  of  the  processing  complexity  required,  the  chosen 
algorithm  appears  to  be  a good  compromise. 

*First  Annual  Report -Advanced  Mail  Systems  Scanner  Technology.  NELC  Technical  Report 
TR  1995,  22  October  1975,  p.  79-85 
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The  algorithm  was  programmed  to  operate  on  portions  of  images  utilizing  the  frame 
store  memory  controller  as  the  processor.  Although  the  processor  operates  at  a relatively 
high  execution  rate,  it  requires  about  45  minutes  to  process  a 432  by  440  pel  section  of  an 
image. 

The  first  image  processed  contained  a set  of  concentric  squares  of  different  bright- 
ness. The  image  area  was  divided  into  nine  parts  (three  rows  of  three  columns).  Figure  El 
shows  the  results  of  enhancement  on  the  sets  of  squares.  The  software  program  will  accom- 
modate various  values  of  the  enhancement  constant  K from  zero  to  seven-eighths  in  one- 
eighth  increments.  The  upper  left  and  lower  right  portions  of  Figure  El  are  unenhanced  (K=0) 
The  chart  at  the  lower  left  of  the  figure  shows  locations  and  magnitude  of  the  enhancement 
constants. 

The  Conrac  RQB  monitor  features  a video  signal  polarity-reversing  switch.  With  this 
switch  the  light  and  dark  areas  of  an  image  may  be  transposed.  Figure  El  also  shows  the 
results  of  utilizing  reversed  or  inverted  video. 

The  value  of  the  brightness  of  the  background  in  figure  E 1 is  00.  The  brightness  of 
the  second  square  is  20  and  the  brightness  of  the  small  square  is  60.  In  examining  the  effect 
of  the  various  enhancement  constants  in  figure  El , it  appears  that  the  center  image  is  the 
most  pleasing.  For  this  image  the  enhancement  constant,  K,  equals  0.5.  With  a constant 
K=0.5,  the  gain  of  the  system  is  G = 3.0  at  the  Nyquist  limit.  It  should  be  noted  that  this 
center  area  of  the  image  also  appears  most  pleasing  when  the  negative  video  is  used  for  the 
display.  This  indicates  that  the  algorithm  is  working  properly  for  both  positive  and  negative 
excursions  of  the  video  signal. 

It  should  be  noted  that  the  centers  of  the  images  are  a little  sharper  in  photographic 
, focus  than  the  corners  due  to  the  curvatures  of  the  CRT  face  and  the  camera  field.  However, 

the  enhancement  improvement  observed  by  careful  examination  of  the  CRT  image  is  almost 
as  shown  in  the  photograph. 

The  same  set  of  enhancement  constants  was  employed  in  presenting  a portion  of  the 
typed  image.  The  photograph  and  enhancement  constant  map  are  shown  on  figure  E2. 

Again,  a value  of  K equal  to  about  0.5  appears  to  be  the  best.  This  particular  constant  is 
probably  the  simplest  to  accommodate  in  a real-time  hardware  implementation. 

A second  enhancement  algorithm  was  examined  and  evaluated  on  the  test  bed.  This 
algorithm  uses  the  recursive  digital  filter  process  to  reduce  the  low-frequency  gain  with  re- 
spect to  the  higher-frequency  details  of  an  image.  The  algorithm  was  described  by  Corrington.* 
We  have  used  the  algorithm  on  the  same  test  data  used  for  the  nonrecursive  filter.  This  two- 
dimensional  filter  operates  line-at-a-time  across  and  then  downward  as  in  TV  scan. 

The  dimensions  and  the  coefficients  of  the  matrix  were  the  same  as  used  in  Corring- 
ton’s  example.  Both  the  input  and  output  arrays  are  two  by  two  matrices.  The  paper  states 
that  the  technique  does  not  provide  symmetry  about  either  the  horizontal  or  vertical  axis. 

This  lack  of  symmetry  can  be  observed  in  figure  E3. 

Because  it  was  difficult  to  predict  the  enhancement  effect  which  might  occur  with 
typed  copy,  the  algorithm  was  run  on  a sample  typed  area.  The  results  are  shown  in  Figure 
E4.  The  copy  legibility  of  the  enhanced  areas  is  quite  good.  The  time  to  process  the  two 
quadrants  for  enhancement  is  approximately  20  minutes  in  the  software/hardware  of  the 
frame  store  memory  controller. 


Two  Dimensional  Recursive  Digital  Filters  for  Background  Removal  in  Pictures,  by  Murjan  S 
Corrington,  Circuits  & Systems  Society  Newsletter,  vol  7,  no  6,  December  1973 
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LOCATION  AND  MAGNITUDE 

OF  ENHANCEMENT  CONSTANTS  ENHANCED  NEGATIVE  VIDEO 


LOCATION  AND  MAGNITUDE 
OF  ENHANCEMENT  CONSTANTS 
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Figure  E2.  Effects  of  nonrecursive  filter  enhancement  on  typed  copy  image. 
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Figure  E4.  Effects  of  recursive  filter  enhancement 


The  complexity  of  a hardware  equivalent  of  either  the  recursive  or  nonrecursive 
filter  is  about  the  same.  For  real-time  processing,  high-speed  access  to  the  entire  data 
from  two  previously  scanned  lines  and  the  present  data  is  necessary.  This  requires  two 
high-speed  memory  banks  having  1700  six-bit  words  each,  plus  the  arithmetic  logic  and 
control  unit,  which  is  nontrivial. 


COLOR  FILTERING 


If  colored  inks  and/or  colored  paper  substrates  are  used,  changes  in  reflection  den- 
sity can  be  obtained  by  the  use  of  color  filters  placed  in  the  illumination  or  optical  path. 

The  response  of  a charge  coupled  device  (CCD)  imager  is  not  uniform  with  respect 
to  frequency  of  impinging  radiation.  A CCD  has  much  higher  response  in  the  red  and 
near  infrared  region  than  in  the  blue.  In  order  to  provide  panchromatic  system  response, 
the  illumination  source  is  designed  to  produce  more  spectral  energy  in  the  blue  and  green 
regions  than  in  the  red.  Two  18- inch,  30-watt  fluorescent  tubes  are  used  to  illuminate 
the  exposure  area  of  the  large  drum.  The  tubes  were  obtained  from  GTE  Sylvania.  A 
special  mixture  of  phosphors  was  used  in  the  tubes.  The  ratio  of  blue:  green:  red  energy 
of  illumination  is  about  8:2:1. 

Figure  E5  shows  the  relationship  of  the  relative  responses  of  the  imager  and  the 
illumination  sources.  Also  shown  in  the  figure  are  the  bandwidth  of  the  color  separation 
filter  set.  A 3-inch  gelatine  filter  holder  accommodates  the  Wratten  47B,  58,  or  25  fil- 
ters and/or  neutral  density  filters. 

Often  a goal  in  image  acquisition  is  an  increase  in  print  contrast  ratio  (PCR). 

PCR  is  defined  as  the  absolute  value  of  the  difference  in  reflectance  of  the  substrate 
(background)  minus  the  reflectance  of  the  ink  all  divided  by  the  background  reflectance. 
Or: 


PCR  = 


|Rb  - Rj| 


By  selecting  the  filter  used  in  imaging,  it  is  possible  to  enhance  the  PCR  by  in- 
creasing the  relative  background  reflectance  with  respect  to  the  ink  (or  vice  versa). 

For  our  experiment  a multicolored  subscription  circular  was  mounted  on  the  test 
drum.  The  image  was  captured  at  f 1 6 with  white  light  (no  filter)  and  at  wider  apertures 
with  each  of  the  three  filters. 

Figure  E6  is  a black  and  white  copy  of  the  subject.  Colors  of  the  various  charac- 
ters, borders,  and  backgrounds  are  noted  on  the  figure.  Black,  yellow,  and  dull  red  inks 
are  used  in  printing  the  image. 

Comparative  photographs  of  two  of  the  image  areas  were  taken  for  this  report. 
The  first  of  these  is  of  an  area  near  the  top  of  the  image.  This  area  affords  clear-cut 
examples  of  the  ability  of  color  filtering  to  effect  changes  in  PCR.  Figure  E7  shows  four 
views  of  the  same  portion  of  the  copy.  Starting  with  the  image  in  the  upper  right  which 
was  captured  with  white  light  and  comparing  clockwise  with  the  images  captured  with 
red,  blue,  and  green  filters,  respectively,  distinct  differences  can  be  seen  in  the  informa- 
tion acquired. 
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Figure  E5.  Lamp  and  imager  spectral  response. 
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Figure  E6.  Document  for  color  filtering  study. 
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In  the  black  and  white  image  and,  to  a lesser  degree,  the  green  image  below  it, 
the  panchromatic  response  is  noticeable.  The  word  “week”  is  printed  in  a dull  red  color. 
The  scroll  design  which  follows  the  word  “week”  is  also  in  dull  red  ink.  The  scroll  is 
overlaid  on  a bright  yellow  border.  The  words  “cover”  and  “guarantee”  have  black 
borders  with  yellow  printing  within  the  characters. 

The  choices  of  contrasts  available  can  be  observed  by  comparing  the  four  images. 
For  selection  of  high  contrast  between  the  red  scroll  and  the  yellow  background,  the 
green  Filtered  image  on  the  lower  left  should  be  selected.  For  high  contrast  of  the  out- 
lines of  the  words  “cover”  and  “guarantee”  with  respect  to  the  interior  of  each  letter, 
the  red  filtered  image  in  the  upper  right  should  be  selected.  Also,  the  scroll  and  its 
background  are  completely  missing  in  this  image.  In  the  blue  image  directly  below,  the 
high-reflectance  spectra  of  the  scroll  and  its  yellow  field  have  been  filtered  out  and  that 
portion  of  the  image  turns  very  dark. 

Figure  E8  shows  another  area  of  the  same  image,  also  captured  with  white  light 
and  with  the  three  color  filters.  The  same  modification  of  reflection  density  by  the  use 
of  filters  is  evident  in  this  set  of  images.  As  a general  rule,  the  use  of  a filter  having  the 
same  spectral  passband  as  the  ink  or  substrate  copy  of  interest  will  cause  that  ink  or  sub- 
strate to  be  acquired  as  a higher  brightness  shade.  Conversely,  the  combination  of  a 
filter  and  an  ink  or  substrate  at  the  opposite  ends  of  the  spectrum  tends  to  produce  a 
darker  brightness  level  of  reflection  density. 

One  of  the  concerns  of  the  image  acqusition  process  for  USPS  is  the  ability  to 
read  and  authenticate  signatures.  This  is  especially  true  if  the  originator  of  a letter  or 
contract  document  is  allowed  to  use  ink  of  any  color.  Color  filtering  can  help  in  en- 
hancing the  PCR  of  a signature  if  a way  can  be  found  to  detect  the  color  it  is  written  in. 
If  not,  then  careful  attention  must  be  given  to  provide  a good  panchromatic  system  res- 
ponse. Black  ink  on  white  paper  appears  to  have  essentially  the  same  PCR  regardless  of 
the  filtering  process.  This  portion  of  the  imaging  study  using  spectral  control  of  the  illu- 
mination indicates  that  color  separation  filtering  for  the  production  of  full  color  images 
can  be  accomplished  with  little  difficulty. 

LOGARITHMIC  VIDEO  AMPLITUDE  COMPRESSION 

One  method  of  reducing  the  number  of  bits  required  to  transmit  an  image  with 
little  degradation  in  visual  acceptability  is  to  quantize  the  video  amplitude  information 
in  a logarithmic  fashion.  Conversely,  given  a fixed  number  of  bits  per  pel  for  defining 
the  amplitude,  a much  enhanced  visual  image  can  be  defined  by  using  a log  compression 
technique. 

There  are  some  problems  concerned  with  log  compression.  One  of  these  problems 
is  related  to  the  limits  of  quantization  and  resolution  which  can  be  obtained  from 
analog-to-digital  (A/D)  converters.  There  exists  a limit  to  the  minimum  size  of  the  quan- 
tized steps,  largely  due  to  system  noise  and  the  accuracy  and  stability  of  converter  thres- 
hold circuits.  For  this  reason  in  log  compression  it  is  desirable  to  utilize  the  first  few 
A/D  converter  steps  without  modification  until  a point  is  reached  in  the  sequence  at 
which  log  steps  are  equal  to  or  larger  than  the  A/D  converter  manufacturer's  standard 
step  sizes. 

At  this  point,  there  are  two  options  for  log  partitioning  of  the  remaining  steps. 
One  method  is  to  modify  the  reference  resistor  divider  string  to  provide  logarithmically 
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Figure  E8.  Effect  of  optical  filtering  on  a multicolor  document. 


spaced  voltages  to  the  threshold  devices.  The  alternative  is  to  utilize  the  linearly  spaced 
digital  output  steps  of  the  A/D  converter  and  to  provide  a “lookup  table”  in  read  only 
memory  (ROM)  form.  The  lookup  table  uses  the  A/D  outputs  as  addresses  for  the  ROM 
and  the  programmed  data  stored  become  the  compressed  output  equivalent.  The  latter 
method  has  some  drawbacks,  since  the  fractional  breakpoints  for  the  ROM  table  are  made 
at  integer  digitized  values  rather  than  at  their  true  logarithmic  fractional  values.  The 
method  using  the  nonlinear  A/D  converter  is  being  investigated  under  a Navy  program  at 
NELC,  and  the  USPS  will  automatically  obtain  the  benefits  of  the  results.  Therefore, 
values  have  been  computed  for  the  ROM  table  method  and  the  results  are  discussed 
here.  The  Navy  program  will  compress  only  from  6 bits  to  5 log  bits,  so  the  USPS  will 
evaluate  the  appearance  of  6 bits  compressed  to  5 bits  and  also  4 bits. 

To  find  the  point  of  departure  from  the  linear  digitized  values  to  the  log  steps,  it 
is  necessary  to  solve  for  the  intercept  point  for  the  best  fit  of  the  straight  line  and  the  log 
curve.  For  the  straight  line  portion,  the  value  used  is  n = B(n),  (El) 

where  B(n)  is  the  brightness  of  the  nth  digitized  value.  In  other  words,  the  outputs  of 
the  A/D  converter  are  used  without  modification.  After  the  intercept  point  whose  coor- 
dinates are  nQ,  BQ,  logarithmic  steps  are  taken  in  accordance  with  the  equation 

Bq  (K  + l)n  = B(n).  (E2) 

For  a smooth  transition  between  the  two  curves,  the  slopes  must  be  equal  at  the 
point  of  connection.  Therefore,  the  two  first  derivatives  can  be  equated  as  follows: 

d B(n)  _ 
dn 

= Bq  (K  + l)n  In  (K  + 1)  = B(n)  In  (K  + 1)  = 1 


or 


B(n)  = 


1 

ln(k  + 1) 


at  the  point  BQ,  as  shown  in  the  graph  of  figure  E9. 

Bq  = 1/ln  (K  + 1)  = nD 

and  from  equation  (E2) 

Bm  = B0(K+  l)(nm-no>  = nQ  (K+l)(nm_no> 

— ^ = (K  + 1 ) ^nm  ‘ no) 
n0 


(E3) 


(E4) 


(E5) 
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D OUTPUT  VALUE. 


(E6) 


Bm  l/(nm-no>=  K+ 
no 

Substituting  (E6)  into  (E4)  inverted, 


In  (K  + 1) 


nm  no 


Bm 

i m - 

In  — = 
no 


1 


n 


o 


or 


1 


or 


‘m 


e 


or 


eBm  = nQ  e 


nm/n 


m'"o  = 


noP 


,/n°  ifp  = enm. 


(E7) 


As  an  example,  if  6-bit  linear  digital  signals  are  log  compressed  to  4-bit  digital  sig- 
nals, the  value  of  nm  = 16  and  the  value  of  Bm  = 64. 

Solving  equation  (E7)  for  nQ, 


eBm=  173.9700  and  p + e = 88861 10.5 


1 73.97  = nQ  (8886110.5)  1/n°. 
Try  n0  = 4. 


173.97  = 218.3926  + e. 


Try  nQ  = 4.33. 


173.97=  1 74.2895  + e, 
which  is  close  enough. 
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Solving  for  K + 1 by  substituting  in  equation  (E6)  


64  1/(16-4.33) 


4.33 


= K + 1 = 1.259594291. 


Then  the  series  becomes  as  follows  (Table  El ): 


TABLE  El. 


L 


Six-digit 
Linear  Value 
Breakpoint 

Four-bit 

Binary 

Output 

Remarks 

0 

0 

1 

1 

•<-end  of  linear 

5.054 

5 

equivalence. 

6.366 

6 

8.017 

7 

4.33  X (K  + l)067  = 5.054 

10.100 

8 

12.722 

9 

16.025 

10 

20.185 

11 

25.425 

12 

32.025 

13 

40.338 

14 

50.810 

15 

63.999 

16 

In  this  fashion  a general  table  can  be  derived  for  2-,  3-,  4-,  and  5-bit  breakpoints. 
Table  E2  can  be  used  for  finding  compressed  values  by  entering  the  table  at  the  left  col- 
umns with  the  illumination  corrected  captured  pel  brightness  value  and  reading  the  com- 
parable compressed  value  from  the  appropriate  adjacent  column. 

The  table  can  be  used  for  determining  the  companded  equivalents  of  the  original 
values.  Companded  values  are  those  obtained  by  log  compressing  the  digitized  values  for 
transmission  and  expanding  back  to  linear  values  at  the  receiving  site. 

This  is  done  by  entering  at  the  left  columns  as  before  and  selecting  an  appropriate 
compressed  value  from  one  of  the  remaining  columns.  The  companded  values  are  then 
obtained  by  following  the  value  downward  to  the  arrow  tip  (if  there  is  one)  and  utilizing 
the  value  in  the  far  left  column  as  the  companded  equivalent  of  the  input  number.  In 
the  absence  of  a vertical  line  and  arrow  beneath  a selected  compressed  equivalent,  the 
original  value  in  the  left  column  is  also  the  companded  value. 
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TABLE  E2.  STANDARD  VIDEO  COMPRESSION  CONVERSION. 


The  granularity  of  the  companded  data  is  of  course  greater  than  that  of  the  ori- 
ginal data  set,  but  the  apportionment  of  the  step  sizes  is  made  to  minimize  the  cosmetic 
detractions  to  the  observer. 

A test  was  made  using  the  frame  store  memory  controller  and  a series  of  tempo- 
rary lookup  tables  in  the  frame  store  memory.  This  test  provides  a capability  to  compare 
portions  of  an  image  which  have  been  modified  by  the  companding  simulation  algorithms 
on  a side-by-side  basis.  Figure  E10  is  a photograph  of  the  monitor  showing  the  contin- 
uous tone  girl  portion  of  the  IEEE  facsimile  chart.  The  actual  image  was  captured 
in  the  prescan  mode.  The  corresponding  pel  brightness  data  statistics  show  that  all  the 
captured  image  data  lie  between  brightness  levels  04  and  51.  The  pel  brightness  data 
table  for  the  USPS  facility  photograph  was  also  examined.  The  pel  brightness  data  for 
this  photograph  were  found  to  range  between  09  and  40.  The  IEEE  facsimile  chart 
also  contains  fully  saturated  photographic  blacks  and  whites  for  the  line  image  portions 
of  the  chart.  It  was  therefore  assumed  that  the  girl  portion  of  the  chart  might  be 
accommodated  by  brightness  levels  between  09  and  49. 

A conversion  table  (table  E3)  was  made  to  cover  the  range  of  the  brightness 
values  of  the  two  images  captured  in  the  prescan  mode.  The  extreme  left  column  ranges 
through  the  09  to  49  brightness  levels.  The  next  column  contains  the  values  biased  in 
such  a manner  that  09  brightness  as  captured  and  corrected  represents  00  for  processing. 
The  third  column  from  the  left  contains  the  product  of  the  second  column  and  a gain 
constant,  1.561,  which  expands  the  video  data  to  encompass  the  entire  64-bit  dynamic 
range. 

The  processes  accomplished  in  these  left-hand  columns  will  eventually  be  replaced 
by  a combination  of  analog  and  digital  circuits  which  have  been  designed  to  operate  in 
real  time. 

The  two  pairs  of  columns  remaining  in  table  E3  contain  the  compressed  video 
breakpoints  and  their  companded  equivalents.  The  center  two  columns  contain  data 
for  compression  from  6 bits  to  4 bits.  The  right-hand  two  columns  are  to  be  used  for 
6-bit  to  5-bit  compression. 

The  girl  image  in  figure  E10  was  made  in  part  from  data  found  in  table  E3. 

The  top  and  bottom  portions  of  the  figure  are  generated  directly  from  the  illumination 
corrected  prescan  acquisition.  In  the  next  segment  of  the  image,  the  4-bit  companded 
data  from  table  E3  were  used  in  the  software  program  of  the  frame  store  memory  con- 
troller. In  this  segment  there  are  only  16  brightness  levels  from  black  to  white.  At 
least  nine  of  these  shades  can  be  seen  leftward  from  the  highlight  on  the  girl’s  forehead. 
The  “contouring”  of  these  brightness  levels  is  quite  noticeable. 

Immediately  below  the  4-bit  companded  image  the  5-bit  companded  data  are 
presented.  This  section  of  course  contains  32  brightness  levels  from  black  to  white.  A 
number  of  the  levels  are  separately  discernible  with  careful  scrutiny,  but  the  segment 
is  much  more  pleasing  to  view  becaue  the  contouring  is  hardly  noticeable.  The  values 
of  brightness  used  for  this  portion  of  the  image  were  taken  from  the  right-hand  column 
of  table  E3. 

The  next  segment  below  the  5-bit  strip  contains  full  6-bit  linear  data.  This 
portion  of  the  image  differs  from  the  top  and  bottom  strips  because  it  has  been  linearly 
expanded  to  conform  to  the  data  in  column  three  of  table  E3.  There  is  very  little  dif- 
ference between  the  5-bit  companded  portion  and  the  6-bit  linear  strip.  Some  small 
changes  can  be  seen  across  the  bridge  of  the  nose  and  the  right  cheek. 
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Figure  E10.  Effects  of  video  companding  on  photographic  image, 


The  amount  of  compression  (if  any)  which  should  be  used  in  a USPS  imaging  sys- 
tem will  depend  on  a number  of  factors.  It  is  obvious  that  amplitude  compression  can 
only  eliminate  20-30%  of  video  amplitude  data.  However,  the  video  compression  may  in 
turn  favorably  affect  the  compressibility  of  the  data  when  further  compressed  by  run 
length  encoding. 

The  dynamic  range  of  most  printing  and  display  techniques  is  generally  limited  to 
100:1  or  less.  Therefore,  the  acquisition  of  images  using  a 6-bit  A/D  converter  and  ampli- 
tude compressing  to  5 or  4 bits  appears  to  be  a practical  approach  to  amplitude  resolution. 


RESULTS  AND  CONCLUSIONS 

1.  Two  edge  enhancement  algorithms  have  been  adapted  to  run  on  the  image 
test  bed. 

2.  The  nonrecursive  method  of  edge  enhancement  provides  symmetry  which  the 
recursive  filter  does  not. 

3.  A constant  of  K = 0.5  substituted  in  the  nonrecursive  algorithm  suitably 
enhanced  the  test  pattern  and  the  soft  focus  sample  of  typed  text. 

4.  The  spectrum  of  the  test  bed  illumination  equipment  appears  to  be  adequate 
in  spectral  response  for  color  filtering  and  color  separation. 

5.  The  proper  choice  of  color  filtering  can  greatly  enhance  paper  to  ink  contrast 
ratio  provided  that  the  original  copy  is  not  just  black  and  white. 

6.  Derivation  of  the  equation  for  log  compression  using  commercial  A/D 
converters  is  presented. 

7.  Results  of  the  compression  and  expansion  calculations  are  tabulated  in  the 
report  for  future  reference. 

8.  Portions  of  an  image  companded  from  4 and  5 bits  are  compared  on  a side- 
by-side  basis  with  unbiased,  unexpanded  prescan  swatches  and  a strip  of 
biased,  expanded  linear  6-bit  image. 

9.  There  is  little  difference  between  the  6-bit  linear  and  the  5-bit  companded 
portions  of  the  image. 

10.  The  image  made  from  the  4-bit  companded  data  contains  noticeable  contouring 
of  the  boundaries  between  brightness  levels. 


FUTURE  NELC  PLANS 

1.  Begin  the  design  of  the  real-time  edge  enhancement  circuits  on  a low-priority 
basis. 

2.  Continue  to  search  the  literature  for  other  applicable  enhancement  tec'miques. 

3.  Now  that  the  spectral  bandwidth  of  the  illumination  has  been  verified,  initiate 
a plan  to  provide  a more  efficient  optical  path  for  the  imaging  light.  Consider- 
ation should  be  given  to  both  increased  intensity  and  uniformity  of  intensity 
across  the  data  path. 

4.  For  the  4-bit  and  5-bit  log  compression  equations,  examine  the  possibility  of 
combining  the  compression  process  with  the  illumination  correction  procedure 
so  that  both  are  done  simultaneously  and  in  real  time. 
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APPENDIX  A (TO  TR  2020  APPENDIX  E): 
NONRECURSIVE  FILTER  CALCULATIONS 


For  a two-pole  filter,  the  configuration  is: 


Ec  = E,  Kj  + Ej  K2  Z-1  + Ej  K3  Z~2 


E0  Kj  Z2  + K2  Z + K3 
EI  Z2 

For  high-frequency  enhancement  (edge  enhancement): 

Desire  a gain  of  + 1 at  low  spatial  frequencies  (DC). 

Desire  a gain  of  perhaps  -2  at  the  Nyquist  limit 

Then:  EQ  EQ 

- +1  @ Z = +1  and  = -2  @ Z = -1 
E,  Ej 

and  for  symmetry  of  response,  Kj  = K3. 

Substituting  into  equation  (Al)  above: 

Kj  + K2  + K3  = +1 
Kj  - K2  + K3  = -2 

2K,  + 2K,  = -1  K,  =-0.25  K2  = +1.5 

The  gain  at  half  Nyquist  frequency  where  Z = ±j  is 


(Al) 


-K  j ±jK2  + K3 
-1 


= ± jK2  ± Fjl.5. 


The  above  performance  calculations  can  be  verified  by  graphical  examples  which  follow. 
The  zeros  in  the  above  equation  lie  at  Z = +0.382  and  Z = 2.6 1 8. 
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An  investigation  was  also  made  for  a four-pole  nonrecursive  filter  as  follows: 


For  symmetry,  K]  = K5,  and  K2  = K4. 

Since  stroke  widths  of  typed  characters  are  about  2+  pels  in  width,  the  highest  gain  for 
edge  enhancement  should  occur  at  W Ja.  At  the  Nyquist  limit  and  at  low  spatial  fre- 
quencies (DC),  the  gain  should  be  +1.  Therefore,  for  the  equation 

Eq  K,  Z4  + K2  Z3  + K3  Z2  + K2Z  + K] 

EI  Z4  (A2) 

E E E 

=+l@Z=  +1;~  = +1  @ Z = -1  = - 2 @ Z = ± j 

E,  Ej  E! 

Then: 

2K,  +2K2  + K3  = +1 
2K,  -2K2  + K3  = +1 

2K,-K3  = -2  or  K3  = 2K,+2 

Kj  = -0.25  =K5 

k2  = 0.0  = k4 

K3  = +1,5 

Hence,  the  desired  equation  is: 

Eq  -0.25  Z4+ 1.5  Z2 -0.25 


The  roots  of  the  equation  lie  at  Z = +0.41449  and  Z = 2.41421.  Wave  forms  of  the  response 
of  this  filter  are  given  in  comparison  to  the  two-pole  filter. 
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INTRODUCTION 


This  report  discusses  reliability  prediction  criteria  (as  they  apply  to  the  scanning 
imager  electronics  being  developed  for  the  US  Postal  Service).  The  implications  of 
variations  of  some  of  the  more  important  parameters  are  also  discussed.  Computations 
are  included  based  on  the  reliability  formula  presented,  for  small,  medium,  and  large 
scale  integration  devices  such  as  CCD  scanners,  ROMs  RAMs,  PROMs,  and  micropro- 
cessors. 

Where  available,  manufacturer’s  device  reliability  data  are  presented  for  com- 
parison to  the  theoretical  calculations.  It  should  be  noted  that  manufacturers  are,  in 
general,  treating  scanning  imagers  like  other  medium  to  large  scale  integration  devices 
as  far  as  reliability  is  concerned.  However,  the  Rome  Air  Development  Center  has 
funded  a “Degradation  Analysis  of  CCD/CID  Devices”  in  their  continuing  efforts  to 
keep  MIL-HDBK-217B  current. 

This  handbook  is  one  of  a series  of  military  standardization  handbooks.  Its 
title  is  “Reliability  Prediction  of  Electronic  Equipment,”  dated  20  September  1974, 
and  it  is  the  basis  for  much  of  the  theoretical  discussion  in  this  report.  Although  very 
conservative,  the  Handbook  is  widely  used  in  industry  and  is  the  only  approved  guide 
for  making  reliability  predictions  for  military  equipment. 


RELEVANCE  TO  DoD  MISSION 

Previous  reports  have  reviewed  the  similarities  between  USPS  imaging  goals  and 
the  objectives  of  DoD.  It  follows  that  the  military  would  be  much  concerned  with  the 
potential  reliability  of  hardware  using  solid-state  imaging  devices.  This  report  has  in 
fact  used  the  approved  DoD  reference,  MIL-HDBK-2 1 7B,  for  making  the  MTBF  pre- 
dictions. Therefore,  it  is  only  necessary  to  adjust  the  final  calculations  for  the  environ- 
ment of  military  usage  of  such  equipment  to  have  a report  on  the  MTBF  of  scanning 
imager  electronics  for  DoD  missions. 


RELIABILITY  PREDICTION  CONCEPTS 

The  design,  fabrication,  and  development  of  large  comple\  electronics  equipment 
that  is  pushing  and  using  the  latest  in  the  state  of  the  art  can  well  be  considered  to  be 
revolutionary  in  nature  as  compared  to  the  building  of  a simple  amplifier  for  listening 
to  records.  Establishing  a reliability  figure  of  system  failures  per  million  hours  is  going 
to  be  much  easier  and  far  more  accurate  for  the  simple  amplifier  simply  because  every 
component  has  an  established  track  record.  The  reliability  predictions  of  failures  per 
million  hours  could  be  taken  as  a statement  of  fact  with  a very  high  confidence  level, 
whereas  the  reliability  predictions  for  the  very  complex  electronic  systems  must  be 
considered  for  what  they  are  - predictions.  They  most  likely  are  based  on  extrapolations 
of  data  generated  for  generically  similar  devices. 

The  scanning  imager  electronics  equipment  certainly  represents  the  state  of  the 
art  in  its  incorporation  and  utilization  of  the  latest  in  imagers,  memory  devices,  and 
processors.  The  DoD  Standardization  Handbook,  “Reliability  Prediction  of  Electronic 
Equipment,”  MIL-HDBK-2 17B,  dated  20  September  1974,  from  which  much  of  the 
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following  theoretical  data  were  obtained,  contains  extensive  data  on  micro-electronic 
devices,  including  bipolar  and  MOS  devices  and  digital  and  linear  devices,  and  covers 
complexities  ranging  from  discrete  logic  elements  to  large  scale  integration  devices.  How- 
ever, in  spite  of  the  volume  of  data  the  handbook  contains,  including  formulae  for 
making  reliability  predictions  on  equipment  as  large  as  desired,  it  must  be  kept  in  mind 
that  the  scanning  imager  electronics  package  may  well  contain  one  of  the  largest  active 
memory  banks  ever  conceived  (25  x 106  bits),  thus  lowering  the  confidence  level  of 
any  reliability  predictions  computed.  Certainly  the  Handbook  formulae  were  not 
developed  by  building  and  evaluating  equipment  of  this  complexity. 

The  Handbook  describes  two  methods  of  predicting  reliability:  parts  stress 
analysis  and  parts  count.  “Parts  count”  is  the  simpler  approach  that  is  frequently  used 
in  making  proposals.  It  will  not  be  discussed  further  in  this  report.  “Parts  stress  ana- 
lysis” is  the  method  used  and  discussed  in  detail  in  this  report.  In  addition  to  the 
limitation  on  type  of  failure  analysis  discussed,  this  report  will  only  deal  with  the 
various  integrated  circuit  semiconductor  devices  that  may  be  encountered  in  the  scan- 
ning imager  electronics.  Failure  rate  models  and  data  are  available  for  all  types  of 
devices  required  to  build  an  operating  electronics  package  and  certainly  must  be  con- 
sidered in  a complete  failure  analysis  of  an  electronics  system;  however,  that  is  beyond 
the  scope  of  this  report. 


FAILURE  RATE  PREDICTION  MODELS 

The  general  failure  rate  prediction  model  for  microelectronic  devices,  as  given 
in  MIL-HDBK-217B,  is 

Xp  = nL  ttq  (Cj  7rT  + C2  7te)  (FI) 

where 

Xp  is  the  part  failure  rate  in  failures  per  106  hours, 

7tl  is  the  device  learning  factor,  ranging  from  1 for  devices  in  full 

production  to  10  for  new  devices  in  the  development  stages, 

ttq  is  the  quality  factor,  ranging  from  1 for  the  most  stringent 
military  specification  grades  to  150  for  commercial  grades, 

ttj-  is  the  temperature  acceleration  factor,  ranging  from  less  than 
0.1  to  over  1000, 

irE  is  the  application  environment  factor,  ranging  from  0.2  for  very 
docile  ground  conditions  to  10  for  missile  launch  conditions,  and 

Cj,C2  are  the  complexity  factors,  ranging  from  about  0.001  to  about  10. 

This  model  applies  to  bipolar  and  MOS,  digital  and  linear,  SSI  to  LSI  (small  scale 
integration  to  large  scale  integration),  and  memories.  Tables  and/or  formulae  are  pre- 
sented in  appendix  A (and  MIL-HDBK-217B)  to  determine  the  values  of  each  parameter 
for  any  type  and  size  of  microelectronic  device.  The  7rL,  ttq,  and  jte  factors  are 
fabrication  or  application  oriented,  whereas  the  Cj  and  C2  factors  are  tailored  to 
specific  device  types  and  sizes.  The  ;rT  factor  is  both  application  and  device  oriented. 
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Equation  (FI)  gives  a failure  rate  for  one  device  such  as  a MOS  random  access 
memory  or  TTL  shift  register  in  terms  of  failures  per  million  hours  (the  actual  calculated 
value  for  Xp  could  be  much  less  than  1.0).  It  is  not  difficult  to  determine  from  the 
equation  and  the  ranges  for  the  various  parameters  that  failure  rates  of  tens  to  hundreds 
or  even  thousands  per  million  hours  could  be  generated  for  large  developmental  or  com- 
mercial devices  operated  in  adverse  environment  conditions.  Conversely,  relatively  low 
failure  rates  can  be  obtained  for  production  items  made  to  rigid  military  specifications 
and  operated  in  favorable  environments,  even  for  relatively  large  microelectronic  devices. 

To  determine  the  expected  MTBF  (mean  time  between  failures)  for  a piece  of 
hardware,  the  general  approach  is  to  sum  the  failure  rates  for  all  the  parts  used  in  the 
piece  of  hardware  and  divide  that  sum  into  1 million.  Stated  algebraically 


MTBF  = 


1 000  000 


+ Np7  Xp 


2 + Np3  Xp3 


where 


MTBF  is  the  mean  time  between  failures  in  hours, 

N is  the  number  of  parts  of  type  Pj,  P->,  or  P3,  etc  and 
X is  the  failure  rate  for  parts  of  type  P| , P2,  or  P3,  etc. 

It  can  be  deducted  from  equation  (F2)  that  the  MTBF  of  a piece  of  hardware 
will  become  less  as  the  number  of  parts  goes  up.  However,  from  the  discussions  so 
far,  it  is  not  apparent  that  it  may  be  desirable  to  use  larger  microelectronic  devices  in 
order  to  cut  down  the  number  of  individual  devices.  This  comes  about  in  the  methods 
used  for  determining  the  complexity  factors.  SSI,  MSI,  linear,  and  memories  all  use 
the  form 


C = KqN 


where 


C is  the  complexity  factor, 

Ko  is  a constant, 

K]  is  a constant  ranging  from  0.35  to  0.76.  and 

N is  the  number  of  transistors,  gates,  or  bits  as  appropriate. 

The  value  of  Kj  being  less  than  1.0  is  the  key.  For  any  failure  rate  prediction  model 
that  calculates  the  complexity  factors  in  a manner  equivalent  to  equation  (F3),  it  is 
desirable  to  use  as  large  a micro-electronic  device  as  can  be  obtained. 

For  LSI  devices  the  method  of  calculating  the  complexity  factors  is  of  the  form 


C = Kq  e 


where 


e is  the  base  of  natural  logarithms,  2.718, 
Ko>K,  are  constants,  and 
G is  the  number  of  gates  in  the  device. 


With  this  form  of  complexity  factor  calculation,  the  increase  in  the  value  of  C is  slower 
than  the  increase  in  number  of  gates  only  up  to  about  250  gates  (LSI  is  considered  100 
gates  or  larger)  using  the  presently  accepted  value  for  Kj.  In  the  range  of  250  to  about 
1350  gates  the  value  of  C still  does  not  get  too  large;  but  above  1400  gates,  in  a LSI 
device,  the  value  of  C begins  to  grow  at  a rate  that  suggests  such  devices  are  not  practical. 
(The  Handbook  appears  to  be  excessively  conservative  for  large  LSI  devices.) 

The  complexity  factors  have  been  discussed  at  length  because  they  are  the  ones 
of  most  interest  in  determining  hardware  implementation  philosophy  for  very  large  and 
sophisticated  systems  such  as  the  scanning  imager  electronics.  Careful  analysis  of  dif- 
ferent hardware  implementation  concepts  could  make  a significant  difference  in  MTBF 
figures  based  solely  on  how  different  microelectronic  devices  affect  the  complexity 
factors. 

The  7^,  ttq,  Trg,  and  7rj  factors  have  just  as  much  effect  on  MTBF  as  the  com- 
plexity factors,  but  there  is  very  little  subtlety  in  their  application.  It  is  obvious  that 
it  is  best  to  choose  a device  that  has  been  in  production  for  some  time  and  is  made  to 
rigid  standards  for  low  7T£  and  7Tq  values,  respectively.  The  environment  factor,  rg, 
is  not  usually  subject  to  change.  If  a system  has  to  work  while  airborne,  that  is  where 
it  has  to  work  and  the  7T£  factor  is  thus  determined.  The  temperature  acceleration 
factor,  7r-p,  is  somewhat  more  subtle.  Obviously,  the  temperature  of  the  operating 
environment  can  be  controlled  in  most  applications  by  some  means.  The  subtlety  of 
this  factor  comes  about  in  that  the  types  and  sizes  of  microelectronic  devices  chosen 
for  the  hardware  implementation  can  be  significant  in  determining  the  actual  micro- 
electronic device  junction  temperature  upon  which  7Tj  is  based. 


RELIABILITY  PREDICTION  COMPUTATIONS 


In  this  section  failure  rates  will  be  calculated  for  various  microelectronic  devices 
typical  of  those  used  in  the  scanning  imager  electronics  and  then  these  failure  rates  will 
be  used  to  arrive  at  a MTBF  figure  for  the  entire  scanning  image  electronics  package. 
Where  practical,  various  combinations  of  devices  will  be  considered;  ie,  a memory  bank 
using  many  small  devices  versus  a few  large  devices  doing  the  same  task.  It  should  be 
kept  in  mind  that  the  reliability  prediction  models  being  used  will,  of  necessity,  be 
conservative,  thus  producing  low  MTBF  figures.  It  would  serve  no  useful  purpose  to 
generate  overly  optimistic  figures.  It  would  be  reasonable  to  assume  that  the  figures 
arrived  at  will  be  worst  case. 

In  the  computations  that  follow,  the  7T£,  ttq,  and  W£  factors  will  always  be  the 
same,  so  a set  of  values  will  be  assigned  to  them  now  and  entered  into  equation  (FI). 
The  values  are  1.0,  5,  and  1.0,  respectively.  Thus  equation  (FI)  becomes 


The  reasoning  used  in  determining  the  above  factors  is  discussed  in  the  following  five 
paragraphs. 

It  was  stated  earlier  that  the  learning  factor,  7 r^,  had  a range  of  1 to  10.  (The  handbook 
actually  says  the  value  of  7r^  is  either  1 or  10.)  A value  of  1 will  be  used  because  it  can  be  as- 
sumed that  by  the  time  any  hardware  goes  into  production  the  learning  process  is  over.  Any 
devices  selected  for  use  in  the  scanning  imager  electronics  should  definitely  be  production  items. 

The  value  chosen  for  the  quality  factor,  7Tq,  is  a little  more  difficult  to  determine. 

It  would  be  easy  to  just  say,  “use  the  best  parts  possible,”  but  that  is  not  reasonable.  The 
choice  of  parts  quality  assurance  level,  ie  ttq,  has  a significant  effect  on  the  cost  of  the 
parts.  The  range  was  given  as  1 to  150.  The  150  is  for  commercial  grades,  which  are 
definitely  unacceptable.  For  high-quality  parts,  the  handbook  shows  five  categories 
based  on  testing,  fabrication,  and  manufacturing  controls  for  which  the  7Tq  factor  ranges 
from  1 to  16. 

The  lowest  “class”  of  quality  parts,  class  C,  which  receives  the  ttq  value  of  16, 
does  not  receive  any  burn-in  screening.  The  next  better  class  is  B2,  for  which  7Tq  is 
10.  This  class  of  parts  receives  a bum-in  screening  and  such  other  tests  called  out  in 
MIL-STD-8S3,  Method  5004,  Class  B,  as  the  vendor  considers  important.  Class  B1 
parts,  which  receive  a 7Tq  of  5,  have  received  all  the  testing  called  out  in  MIL- STD-883, 
Method  5004,  Class  B,  including  the  same  burn-in  screening  that  Class  B2  parts  receive. 

The  full  Class  B parts,  for  which  7Tq  is  2,  have  certain  restrictions  put  on  the  manufac- 
turing and  fabrication  processes  in  addition  to  passing  tests  required  of  class  B2  parts. 

Class  A parts,  the  very  best  that  industry  can  produce,  receive  a 7Tq  value  of  1.  These 
parts  receive  a longer  burn-in  and  have  even  more  stringent  restrictions  on  manufacturing 
and  fabrication.  Vendors  supplying  class  A and  B parts  must  be  certified  as  being  quali- 
fied and  must  be  recertified  periodically  to  keep  their  status. 

The  value  for  7Tq  was  set  at  5,  the  value  given  to  class  B1  parts.  The  reasoning 
is  that  these  parts  have  received  the  full  MIL-STD-883  testing,  which  includes  a significant 
burn-in.  It  probably  is  premature  to  consider  that  the  fabrication  restraints  of  full 
class  B parts  could  be  applied  to  the  very  large  memory  devices.  Certainly  full  class  B 
parts  are  going  to  be  considerably  more  expensive  - on  the  order  of  5 times.  Class  B2 
parts  with  a 7Tq  of  10  would  also  be  a good  choice  if  costs  become  a significant  factor. 
(Hughes  Aircraft  has  extensive  data  to  show  that  their  delivered  hardware  will  have 
MTBF  figures  commensurate  with  full  class  B parts  even  though  they  have  used  class  C 
parts  and  in  some  instances  class  D parts.  This  is  attributed  to  the  fact  that  the 
operating  time  accumulated  by  the  time  the  equipment  is  delivered  is  sufficient  to 
produce  the  effect  of  class  B screening.) 

The  range  of  the  environment  factor,  tfg,  was  given  as  0.2  to  10.  Table  2.1. 5-3 
in  appendix  A lists  several  categories  and  associated  values  for  7rg.  The  category  that 
is  most  appropriate  for  this  application  is  “ground,  fixed”  with  a value  of  1.0  for  7rj.. 

The  7Tj  factor  is  a computed  factor  that  is  dependent  on  three  items:  ambient 
temperature,  device  size,  and  device  type.  The  ambient  temperature  will  be.  in  the  end, 
determined  by  the  equipment  design  and/or  the  operating  environment.  For  the  pur- 
poses of  this  report  it  will  be  assumed  that  the  ambient  will  be  controlled  to  50°C. 

The  device  size  affects  the  computations  in  that  the  size  generally  affects  the  level 
above  ambient  at  which  the  device  junctions  operate.  This  information  is  generally 
available  for  microelectronic  devices;  however,  the  Handbook  gives  a guideline  in  the 
absence  of  actual  data,  ie,  10°C  for  devices  with  no  more  than  120  transistors  and 
25°C  for  devices  with  more  than  120  transistors.  For  this  report  the  junction 


F-7 


temperature,  Tj,  used  for  all  computations  will  be  either  60°C  or  75°C.  The  device 
type  determines  which  of  two  Tj  values  are  used  in  the  ffj  computations. 

The  expression  for  irj  is 


ttt  - 0.1  ex  , (F6) 

where 

e is  the  natural  log  base,  2.718,  and 

X - (-)  (Kj  or  K2)  Yj  - 273  ~ 298’  (F7) 

Tj  is  the  junction  temperature  in  °C  (60°  or  75°  for  this  report): 

K]  = 8121  for  bipolar  and  MOS  linear,  bipolar  beam  lead,  bipolar 

ECL,  and  all  other  MOS  devices;  and 

K->  = 4794  for  bipolar  digital  devices,  ie,  TTL,  DTL,  and  devices  not 

included  by  Kj. 


Using  the  values  stated  above  for  Tj,  the  values  for  ttj  are  calculated  and  presented  in 
table  FI.  Unless  specifically  noted,  all  the  computations  in  the  rest  of  this  report  will 
use  one  of  the  tabulated  values. 


TABLE  FI. 


”T 

Devices  T;  = 60°C  T;  = 754C 

Types  < 120  transistors  > 120  transistors 

Kl 

BP  and  Mos  linear,  1.75  5.04 

BP  beam  lead, 

BP  ECL,  and  all  other 
MOS 

BP  digital  0.54  1.00 

(ie,  TTL,  DTL,  and 
devices  not  included 

in  Ki) 


SCANNING  IMAGER  ELECTRONICS 

The  scanning  imager  electronics,  for  which  the  following  computations  are  made, 
is  a hypothetical  electronics  package  modeled  after  the  hardware  built  by  NELC  Display 
Division.  The  NELC  hardware  is  capable  of  storing  (in  active  memory)  only  about  one- 
eighth  of  a page  at  a time  of  6-level  Gray  scale  data.  The  system  envisioned  for  the 
computations  of  this  report  will  be  capable  of  full-page  storage.  The  complement  of 
microelectronic  devices  required  for  this  system  is  given  in  table  F2.  In  the  following 
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sections  \p,  failure  rate  per  million  hours,  will  be  calculated  for  each  of  the  1 0 device 
types  listed.  Then  an  MTBF  figure  will  be  compiled  for  the  entire  package. 


TABLE  F2.  SCANNING  IMAGER  ELECTRONICS 
MICROELECTRONICS  COMPLEMENT. 


LSI 

SSI/MSI 

Memory/CCD 

Equiv 

Equiv 

no 

no 

Device 

Technology 

qty 

Gates 

qty 

Gates 

qty 

bits 

Main  processor 
CCD  imager 

MOS 

1 

1700 

INTEL  3001 

TTL 

1 

250 

INTEL  3002 

TTL 

24 

250 

INTEL  3003 

TTL 

3 

30 

MM  I 6306 

TTL 

12 

ROM 

2048 

Misc 

TTL 

100 

50 

Misc 

TTL 

200 

20 

Memory  bank 
T1  TMS4030 

MOS 

6000 

RAM 

4000 

Alternate  device 

MOS 

1500 

RAM 

1600 

Alternate  device 

MOS 

375 

RAM 
64  000 

Image  analyzer 

ECL 

24 

RAM 

64 

Misc 

ECL 

250 

10 

LARGE  SCALE  INTEGRATION 

MIL-HDBK-217B  defines  LSI  as  being  a device  that  is  equivalent  to  100  gates  or 
larger.  One  gate  is  assumed  to  use  four  transistors  and  a J-K  or  R-S  flip-flop  is  con- 
sidered to  have  8 gates.  By  definition,  memory  devices  would  be  considered  LSI;  how- 
ever, the  Handbook  provides  a separate  reliability  prediction  model  for  them.  Therefore, 
for  the  balance  of  this  report,  LSI  will  include  only  those  large  digital  microelectronic 
devices  that  are  not  considered  to  be  memory  devices.  Microprocessor  and  arithmetic 
devices  would  (as  of  this  report  date)  be  considered  LSI.  Charge  coupled  and  charge 
injection  imaging  devices  are  also  LSI  devices  by  the  above  definition.  The  Handbook 
makes  no  mention  of  such  devices;  however,  it  is  the  judgment  of  this  author  that  they 
should  be  considered  ROM  type  memory  devices  for  reliability  prediction  purposes. 

They  are  laid  out  in  the  orderly  fashion  of  a memory  device  as  opposed  to  the  random 
configurations  encountered  in  other  LSI  devices,  and  they  are  more  like  ROM  in  that 
they  receive  only  signals  for  outputting. 
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Section  2.1.3  of  appendix  A provides  the  necessary  information  to  apply  equation 
(F5),  which  is  repeated  here,  to  the  LSI  devices  in  table  F2. 


XP  ^ 

5 (Cj  Try  + C) 

(F5) 

Cl  = 

0.0187  e0  005G 

(F8) 

II 

<N 

u 

0.013  e 0004G 

(F9) 

try  — 

See  table  1 

In  table  F2  there  are  two  LSI  devices  listed;  however,  both  types  have  250 
gates,  and  they  are  bothTTL  technology,  so  only  one  Xp  calculation  is  necessary.  From 
table  FI  the  Try  value  is  determined  to  be  1.00.  Therefore,  computing  Cj  and  C-> 

Cj  = 0.0187  e^-005)  (250) 

= 0.0653 

C2  = 0.013  e(°-004)  (250) 

Putting  all  of  values  determined  into  equation  (F5) 

XLSi  = 5 [ (0.0653)  (1.00)  + 0.0353] 

= 0.503  failure  per  10^  hours 

MEMORY  DEVICES 


From  section  2.1.4,  appendix  A,  the  expressions  for  Cj  and  C2  for  ROMs  are 


Cl  = 

0.00114  B0-603 

(F10) 

c2  - 

0.00032  B0-646  , 

(FI  1) 

and  for  RAMs 

Cl  - 

0.00199  B°  603 

(FI  2) 

c2  = 

0.00056  B0-644 

(FI  3) 

There  is  only  one  type  of  ROM  listed  in  table  F2  and  it  is  TTL  with  2048  bits. 
From  table  FI  the  value  of  try  is  determined  to  be  1.00.  Cj  and  C2  are  computed  to 
be  0. 1 131  and  0.04408.  respectively.  Putting  these  values  into  equation  (F5) 

Xrqm  = 5 [ (0.1131)  (1.00)  + 0.0441] 

= 0.786  failure  per  10^  hours 
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There  are  three  sizes  - 4000, 16  000,  and  64  000  bits  - of  MOS  RAM  listed  in 
table  F2  and  one  size,  64  bits,  of  ECL  RAM.  From  table  FI,  the  7rj  value  is  5.04  for 
all  devices.  Cj  and  C2  for  each  of  the  four  devices  are  computed  to  be: 


Cl 

C2 


64  ECL 
0.02443 
0.008 1 5 


4k  MOS 
0.29571 
0.11692 


16k  MOS 
0.68221 
0.28551 


Using  equation  (F5),  the  Xp  values  are  computed  to  be 


X64  RAM 
X4k  RAM 
*16k  RAM 
X64k  RAM 


0.6564  failure  per  10^  hours, 
8.036. 

18.619,  and 
43.131. 


64k  MOS 

1.5733 

0.6969 


CCD  SCANNING  IMAGER 

It  was  stated  earlier  that  the  charge  coupled  device  used  for  image  scanning 
would  be  treated  like  a ROM  for  failure  rate  prediction  purposes.  Therefore,  equations 
(F10)  and  (FI  1)  are  appropriate  for  Cj  and  C2  calculation  and  7Tj  is  determined  to  be 
5.04  from  table  FI.  Cj  and  C2  are  computed  to  be  0.1765  and  0.0391,  respectively. 
The  Xp  then  computes  to  be 

XCCD  = 5 [ (0.1765)  (5.04)  + 0.0391] 

= 4.64  failures  per  10^  hours. 


MEDIUM/SMALL  SCALE  INTEGRATION 

From  section  2.1.1.  appendix  A,  the  expressions  for  C|  and  C->  are 

C,  = 0.00129  G0-67  and  (FI 4) 

C2  = 0.00389  G0-35  (FI  5) 

There  are  three  sizes  - 20,  30,  and  50  equivalent  gates  - of  MSI/SSI  TTL  devices 
listed  in  table  F2  and  one  size  of  ECL  device.  From  table  FI.  the  7Tj  values  are  0.54 
for  the  20-  and  30-gate  TTL  devices,  1.00  for  the  50-gate  TTL  device,  and  1.75  for  the 
ECL  device.  The  computed  values  of  C|  and  C2  for  the  various  devices  are 


TTL 

TTL 

TTL 

ECL 

20 

30 

50 

10 

Cl 

0.0096 

0.0126 

0.0177 

0.0060 

c2 

0.0111 

0.0128 

0.0153 

0.0087 
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Using  equation  (F5),  the  computed  values  of  Cj  and  C2,  and  the  values  for  7rj,  the 
Xp  values  are  computed  to  be 


20  TTL  = 

0.0814  failure  per  10^  hours. 

30  TTL  = 

0.0980, 

50  TTL  = 

0. 1650,  and 

10  ECL  = 

0.0960. 

SCANNING  IMAGER  ELECTRONICS  MTBF 

The  MTBF  for  the  scanning  imager  electronics  is  computed  using  equation  (F2), 
which  is  repeated  below. 


MTBF  = 


1 000  000 


NPj  XP,  + NP,  XP, 


hours 


(F2) 


The  number  of  parts  of  each  type  of  microelectronic  device  is  determined  from  table  F2, 
and  the  Xp  values  have  just  been  calculated  for  the  various  devices.  In  table  F3  the 
total  failures  per  million  hours  have  been  determined  for  each  type  of  device.  In  table 
F4  an  MTBF  has  been  determined,  according  to  equation  (F2),  for  the  scanning  imager 
electronics  for  three  different  memory  bank  devices. 


TABLE  F3.  SCANNING  IMAGER  ELECTRONICS 
FAILURES  PER  106  HOURS. 


Device 

Np 

Xp 

NpXp 

CCD  imager 

1 

4.64 

4.64 

Intel  3001 

1 

0.503 

0.50 

Intel  3002 

24 

0.503 

12.07 

Intel  3003 

3 

0.098 

0.29 

MM1  6306 

12 

0.786 

9.43 

Misc  TTL 

100 

0.1650 

16.50 

Misc  TTL 

200 

0.0814 

16.28 

TMS4030  4k  RAM 

6000 

8.036 

48216.0 

Alternate  16k  RAM 

1500 

18.619 

27928.0 

Alternate  64k  RAM 

375 

43.131 

16174.0 

ECL  RAM 

24 

0.6564 

15.75 

Misc  ECL 

250 

0.0960 

24.00 

TABLE  F4.  SCANNING  IMAGER  ELECTRONICS  MTBF. 


Memory 

Bank  Failures  Per  10^  Hours 


Device 

Failures 

All  Other 
Parts 

Sum  of 
Failures 

MTBF 

hours 

4k  RAM 

48216 

99.46 

48316 

20.7 

16k  RAM 

27928 

99.46 

28028 

35.7 

64k  RAM* 

16174 

99.46 

16274 

61.4 

‘Acceptable  64k  RAM  may  not  be  available  in  the  required  time  frame. 

The  computed  MTBF  figures,  21  to  61  hours,  for  the  hypothetical  scanning  imager 
electronics  — even  using  futuristics  64  000-bit  memory  chips  - is  definitely  undesirable 
and  most  likely  unacceptable.  Such  low  figures  do  not  mean  that  there  is  no  hope.  Sev- 
eral facts  should  be  kept  in  mind  and  examined  for  methods  of  improvement,  including: 

1.  The  numbers  are  predictions  based  on  a conservative  approach. 

2.  The  best  parts  possible  (7Tq  = 5 was  used)  were  not  used  in  the  computations. 

3.  The  system  MTBF  is  controlled  entirely  by  the  memory  bank. 

4.  The  temperature  acceleration  factor,  7Tj,  is  a significant  factor  in  the 
computations. 

5.  Actual  reliability  figures  for  the  various  devices  may  be  one  to  two  orders 
of  magnitude  better  (see  the  following  section  on  manufacturer’s  data). 

Taking  the  above  statements  in  order,  the  first  deals  with  the  degree  of  con- 
servatism built  into  MIL-HDBK-21 7B.  There  is  the  possibility  that  actual  practice  may 
produce  a factor  of  10  improvement,  but  that  could  only  be  determined  after  the  fact, 
which  could  be  an  expensive  gamble  if  the  improvement  did  not  materialize.  The 
confidence  level  in  such  a venture  is  put  at  less  than  10%.  A 2:1  improvement  is  much 
more  palatable  - the  confidence  level  on  this  is  put  at  90%.  thus  producing  MTBF  times 
of  41,  71,  and  123  hours. 

Class  B1  parts  were  selected,  giving  a 7tq  of  5.  This  factor  is  inversely  propor- 
tional to  MTBF,  thus  very  effective.  Reduce  7Tq  by  a factor  of  2 and  MTBF  goes  up 
by  2.  This  looks  good  at  first  glance  but  at  best  can  give  only  5:1  improvement  — 

Class  A parts  used  in  satellites  only  reduce  itq  to  1 and  the  cost  is  definitely  unattractive. 
One  of  the  most  important  factors  in  screening  parts  for  a better  quality  assurance  class 
is  burn-in  time.  An  alternative  to  buying  better  parts  is  to  have  the  equipment  manu- 
facturer continue  to  burn-in  the  hardware  before  delivery  for  200  or  more  hours  after 
the  last  part  failure.  This  procedure  could  produce  an  effective  7tq  of  at  least  2.5  with 
a confidence  level  of  90%.  This  would  put  the  predicted  MTBFs  at  82,  142,  and  246 
hours  - still  not  at  all  attractive,  particularly  if  the  64k  RAM  device  is  not  available. 

Comparison  of  columns  one  and  two  in  table  F4  shows  the  number  of  failures 
per  million  hours  for  the  memory  bank  to  be  more  than  a hundred  times  greater  than 
for  all  the  other  parts  put  together  - 280  to  480  times  for  devices  available  today.  With 
this  in  mind,  it  would  do  nothing  to  the  confidence  level  of  the  predictions  if  the  parts 
outside  the  memory  bank  had  an  infinite  life  prediction.  It  was  in  anticipation  of  this 


condition  that  alternative  failure  rate  predictions  were  made  only  for  the  memory  bank 
devices.  Choosing  devices  that  were  4 and  16  times  larger  than  the  devices  used  in  the 
NELC  hardware  resulted  in  MTBF  figures  that  were  1.7  and  3.0  times  better,  respectively. 
Acceptable  16k  devices  are  currently  available;  however,  64k  devices  are  not.  It  would 
have  required  memory  elements  with  a million  bits  for  the  initial  MTBF  prediction  to 
have  been  about  200  hours.  Such  devices  are  definitely  a long  way  off.  What  this  boils 
down  to  is  that  making  larger  devices  will  solve  the  problem  but  is  not  a practical  ap- 
proach. What  is  needed  is  a type  of  memory  device  technology  that  is  inherently  better 
in  reliability  by  a factor  of  10  or  more. 

The  temperature  acceleration  factor,  fly,  appears  to  offer  the  best  possibility  for 
MTBF  improvement.  In  the  discussion  of  fly,  ambient  temperature  ie,  the  temperature 
at  the  mounting  surface  of  the  microelectronic  devices  was  set  at  50°C  (122°F).  This 
produced  a fly  of  5.04  for  large  MOS  devices.  By  lowering  the  ambient  temperature  10°,  fly 
will  be  reduced  by  a factor  of  2,  and  a 15°  reduction  would  reduce  fly  by  a factor  of 
3.  In  the  MTBF  computations  for  the  scanning  imager  electronics  these  reductions  in 
Ay  would  produce  a 200  or  300%  increase  in  MTBF.  Such  reductions  would  definitely 
require  special  cooling  techniques  and  would  add  significantly  to  the  manufacturing 
cost.  A 3:1  improvement  in  fly  produces  MTBFs  of  246,  426,  and  738  hours  for  each 
of  the  three  memory  devices.  These  figures  include  the  two  previous  factors  discussed 
for  MTBF  improvement. 

It  was  suggested  in  a previous  paragraph  that  a device  with  inherently  better 
reliability  was  needed  to  make  a substantial  improvement  in  the  MTBF  prediction.  This 
comment  was  directed  to  the  complexity  factors,  Cj  and  C2,  when  first  made,  but  it 
could  also  be  directed  to  the  fly  factor.  Referring  back  to  the  discussions  on  fly 
and  table  FI,  it  can  be  seen  that  a 5:1  improvement  in  fly  of  the  memory  devices  and, 
consequently,  the  MTBF  of  the  scanning  imager  electronics  could  be  obtained  if  the 
K-i  constant  were  used  instead  of  Kj.  K2  applies  to  bipolar  digital  devices  including 
DT L,  TTL,  and,  in  the  judgment  of  this  author,  I~L  (integrated  injection  logic).  At 
the  time  the  Handbook  was  written,  I~L  was  not  generally  available  so  was  not  mentioned 
in  the  definitions . The  technology  is,  however,  definitely  based  on  bipolar  semiconductor 
materials  and  will  no  doubt  be  included  in  the  next  revision  of  the  Handbook.  Actually, 
a memory  device  using  DTL  or  TTL  would,  theoretically,  give  the  same  MTBF  improve- 
ment; but  these  are  not  practical  technologies  for  such  LSI  devices.  Large  1~L  memory 
devices  are  practical,  however,  and  they  will  be  able  to  meet  the  access  time  require- 
ments. Another  benefit  to  using  I“L  technology  over  MOS  is  a probable  reduction  in 
power  dissipation  by  about  2:1  in  a dynamic  mode;  ie,  while  data  are  being  processed 
and  the  memory  is  being  refreshed  (the  TMS4030  devices  require  continuous  refresh). 

This  power  reduction  does  not  change  the  reliability  predictions,  but  it  makes  it  easier 
to  maintain  a given  temperature,  which  does  affect  reliability.  It  should  be  noted  that 
the  memory  for  the  scanning  imager  electronics,  usin^  the  TMS4030  devices,  would 
dissipate  3 to  5 kilowatts.  In  summary,  the  use  of  I“L  devices  in  the  memory  bank 
could 


1.  Improve  the  MTBF  predictions  to  410.  710.  and  1230  hours  for  the  three 
sizes  of  memory  devices, 

2.  Reduce  total  power  consumption,  and 

3.  Reduce  cooling  requirements. 
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Unfortunately,  4k  devices  are  just  starting  to  come  on  the  market,  so  the  larger  devices 
may  not  be  available  in  the  required  time  frame.  The  MTBF  predictions  for  the  hypo- 
thetical scanning  imager  electronics  started  out  at  a low  of  20.7  hours  and  went  up  to 
1230  hours.  Table  F5  summarizes  the  various  values  and  the  changes  requied  to  get 
the  improved  MTBF  figures. 


TABLE  F5.  SCANNING  IMAGER  ELECTRONICS  MTBF  - 
IMPROVED  VERSIONS. 


MTBF  hours 

Method  of  Improvement 

4k  RAM 

16k  RAM 

64k  RAM 

Calculations  from  table  F4 

20.7 

35.7 

61.4 

Taking  some  conservatism  out 
of  the  calculations  - a factor 
of  2:1 

41 

71 

123 

Improved  7tq  by  a factor  of  2: 1 

82 

142 

246 

Reduce  ambient  temperature  by 
15°C  to  35°C  thus  lowering  n 
by  a factor  of  3: 1 

246 

426 

738 

Use  I^l  memory  devices  in- 
lieu  of  reducing  ambient 
temperature 

410 

710 

1230 

Use  l-L  memory  devices  and 
lower  ambient  temperature 
5°C 

492 

852 

1476 

Use  I^L  memory  devices  and 
lower  ambient  temperature 
10°C 

615 

1065 

1845 

RECENT  IMAGER  DEVELOPMENTS 

There  are  three  principal  manufacturers  of  off-the-shelf  solid-state  imagery 
devices  - RCA,  Reticon,  and  Fairchild.  Their  imagers  most  nearly  compatible  with  USPS 
requirements  are  the  SID51232,  RL  1872F.  and  CCD  131  CD,  respectively. 

RCA  has  made  design  improvements  on  the  SID  51232  by  replacing  the  surface 
channel  horizontal  output  register  with  a buried-layer  equivalent.  This  improves  the 
performance  of  the  device  somewhat  but  does  not  contribute  significantly  to  reliability 
improvement. 

There  have  been  persistent  rumors  throughout  the  CCD  imager  industry  that 
plastic  packages  and  seals  can  and  do  lead  to  degradation  of  performance  of  the  devices. 
Fairchild  has  offered  tor  sale  new  versions  of  the  CCD  121CD  (the  1728  pel  device) 
and  the  CCD  131CD  (the  dual-ported  1024  pel  device  operating  at  12  megapels  per 
port)  which  are  hermetically  sealed  in  new  dual  in-line  packages  (DIPs).  This  type  of 
package  should  greatly  improve  the  useful  life  of  devices  from  the  standpoints  of  both 
chemical  surface  contamination/corrosion  and  possible  humidity  condensation  on  the 
inside  of  the  quartz  imaging  window. 
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There  exists  a great  deal  of  latitude  in  the  value  of  MTBF  which  can  be  obtained 
for  an  imaging  device.  Using  MIL-HDBK-217B,  many  values  of  MTBF  can  be  calculated. 
If  one  assumes  a high  complexity  factor  C,  and  a high  device  learning  factor  jr^,  the 
MTBF  estimate  may  be  as  high  as  100  failures  per  10^  hours.  Lower  factor  choices 
may  provide  about  18  failures  per  10^  hours.  Actual  life  tests  by  a manufacturer  may 
yield  estimates  on  the  order  of  0.5  failure  per  10^  hours. 

WARRANTIES 

Warranties  on  CCD  devices  are  almost  nonexistent.  RCA  offers  a 90-day  warranty 
on  the  CCD  cameras  and  imagers.  The  Lancaster  marketing  manager  for  the  product  line 
explains  that  the  items  are  covered  under  paragraph  7(a)  of  RCA  Lancaster  Terms  and 
Conditions,  IVM-2,  dated  8-30-76.  A copy  of  paragraph  7 is  reproduced  with  permission 
in  appendix  B.  RCA  considers  these  products  to  be  developmental  items.  Consequently, 
under  the  specific  adjustment  terms  referenced  in  paragraph  7(a),  the  limited  warranty 
period  is  set  at  90  days.  A copy  of  the  limited  warranty  is  also  reproduced  with  per- 
mission in  appendix  B. 

In  the  not  too  distant  future  when  these  items  become  commercial  production 
units,  the  warranty  will  probably  be  extended  to  1 year,  provided  that  the  claim  is 
made  within  18  months  of  th&  purchase.  This  latter  clause  allows  the  purchaser  a 6- 
month  acquisition  holding  period  before  the  equipment  is  powered  up. 

Fairchild  does  not  warrant  their  devices  but  publishes  a data  sheet  with  a Polaroid 
photo  of  a scope  trace  showing  the  performance  of  the  imager  at  recommended  clock 
voltages.  A sample  is  shown  in  appendix  C.  The  reaction  of  the  company  to  a customer 
claim  of  premature  failure  of  a device  is  not  known  at  this  time.  Presumably  Fairchild 
would  analyze  the  device  under  a microscope  to  try  to  determine  whether  the  failure 
was  due  to  abuse  or  workmanship.  Other  campanies  might  also  follow  the  same 
approach. 

CONCLUSIONS 

1.  The  MTBF  of  the  scanning  imager  electronics  model  used  is  82  hours. 

2.  The  principal  contributor  to  the  MTBF  duration  is  the  failure  rate  of  the 
random  access  memory  (RAM)  devices. 

3.  This  dependency  on  the  RAM  device  failure  rate  is  due  to  the  large  number 
(6000)  required). 

4.  The  MTBF  of  the  same  equipment  can  be  increased  to  246  hours  by  using 
64k  RAM  devices. 

5.  The  MTBF  of  the  same  equipment  can  be  further  increased  to  1230  hours 
by  using  integrated  injection  logic  (I^L)  memory  devices. 

6.  The  reliability  of  the  imaging  devices  does  not  measurably  alter  the  MTBF 
of  the  model  equipment. 

7.  The  MIL-HDBK-217  reliability  predictions  for  semiconductor  components  are 
extremely  conservative.  The  NELC  test  bed  memory  is  about  one-eighth  the 

size  of  a full  memory  used  in  the  model  equipment.  There  has  been  one  memory 
failure  in  1475  hours  of  operation,  whereas  the  calculated  value  using  MIL-HDBK 
217B  would  have  been  about  nin:  failures  in  this  same  time  period. 
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1.1  The  Reliability  Problem 

When  it  is  proposed  to  design  an  electronic  system  to  perform  a complex 
and  demanding  job,  it  is  assumed  that  the  required  investment  will  be 
justified  according  -to  the  perfection  by  which  the  job  is  performed  or 
by  the  large  number  of  times  which  the  system  can  do  the  job.  This  assump- 
tion cannot  be  justified  when  a system  fails  to  perform  upon  demand  or 
fails  to  perform  repeatedly.  Thus , it  is  not  enough  simply  to  show  that 
a chasm  can  be  spanned  by  a bridge;  the  bridge  must  continue  to  span  the 
chasm  for  a long  time  to  come  while  carrying  useful  loads. 

In  the  design  of  complex  electronic  systems,  such  an  assumption  as 
mentioned  above,  is,  in  fact,  not  accepted.  Instead,  considerable  effort 
is  made  to  obtain  reliable  system  performance.  Unlike  bridge  building 
and  other  evolving  technologies,  it  is  recognized  that  the  electronics 
art,  especially  complex  military  systems,  is  often  in  revolution.  It  is 
sometimes  referred  to  as  an  exploding  technology.  Without  time  for  orderly 
evolution  of  systems,  applications  of  electronics  suffer  most  from  unrel- 
iability. The  ratio  of  new  to  tried  and  true  portions  of  electronic 
systems  is  relatively  high;  therefore,  until  the  new  becomes  tried  and 
true,  its  reliability  must  be  suspect.  As  an  inevitable  but  not  suprising 
result,  it  can  be  concluded  that  reliability  remains  a special  problem  in 
electronics  and  will  remain  so,  as  long  as  the  technology  is  in  revolution 
rather  than  evolution. 

Reliability  is  a problem  at  all  levels  of  electronics,  from  materials  to 
operating  systems,  because  materials  go  to  make  up  parts,  parts  compose 
assemblies,  and  assemblies  are  combined  in  systems  of  ever  increasing 
ecmplexity  and  sophistication.  Therefore,  at  any  level  of  development 
and  design,  it  is  natural  to  find  the  influence  of  reliability  engineering 
acting  as  a discipline  founded  to  devote  special  engineering  attention 
to  the  unreliability  problem.  Reliability  engineering  is  concerned  with 
the  time  degradation  of  materials,  physical  and  electronic  measurements, 
equipment  design,  processes  and  system  analysis,  and  synthesis.  None  of 
these  can  be  isolated  from  the  overall  electronics  context,  but  must 
be  carried  on  in  conjunction  with  many  other  disciplines. 

1.2  The  Role  of  Reliability  Prediction  in  Engineering 

To  be  of  value,  a prediction  must  be  timely.  However,  the  earlier  it  is 
needed  the  more  difficulties  will  be  encountered.  It  is  certainly 
true  that  the  earlier  a prediction  has  to  be  made  about  the  unknown 
nature  of  a future  event  the  more  difficult  it  is  to  make  a meaningful 
prediction.  As  an  example,  it  can  be  seen  that  the  reliability  of  an 
electronic  equipment  is  kncwn  with  certainty  after  it  has  been  used 
in  the  field  until  it  is  worn  out  and  its  failure  history  has  been 
faithfully  recorded.  But  for  purposes  of  doing  anything  about  the 
reliability  of  this  equipment,  this  knowledge  has  no  value.  Before 
this  point,  reliability  cannot  be  kncwn  with  certainty;  but  a great 
deal  of  knowledge  about  reliability  can  be  accumulated  over  a short 
early  period  in  the  equipments'  useful  life.  Eventhough  the  degree  of 
certainty  of  knowledge  is  less,  there  is  some  opportunity  to  do  some- 
thing to  influence  the  reliability  of  the  remaining  life  portion. 
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Hie  use  of  failure  rate  data,  obtained  from  field  use  of  past  systems, 
is  applicable  on  future  concepts  depending  on  the  degree  of  similarity 
existing  both  in  the  hardware  design  and  in  the  anticipated  environments. 
Data  obtained  on  a system  used  in  one  environment  may  not  be  applicable 
to  use  in  a different  tenvironment,  especially  if  the  new  environment 
substantially  exceeds  the  design  capabilities.  Other  variants  that  can 
affect  the  stated  failure  rate  of  a given  system  are:  different  uses, 
different  operators,  different  maintenance  practices,  different 
measurement  techniques  or  definitions  of  failure.  When  considering  the 
comparison  between  similar  but  unlike  systems,  the  possible  variations 
are  obviously  even  greater. 

Thus  a fundamental  limitation  on  reliability  prediction  is  the  ability 
to  accumulate  data  of  known  validity  for  the  new  application.  Another 
fundamental  limitation  is  the  complexity  of  prediction  techniques.  Very 
simple  techniques  omit  a great  deal  of  distinguishing  detail  and  the 
prediction  suffers  inaccuracy.  More  detailed  techniques  can  become 
so  bogged  down  in  detail  that  the  prediction  becomes  costly  and  may 
actually  lag  the  principle  hardware  development  effort. 

Chis  revision  of  the  Handbook  includes  two  methods  of  reliability 
prediction  - "Part  Stress  Analysis"  in  Section  2 and  "Parts  Count"  in 
Section  3.  Ihese  methods  vary  in  degree  of  information  needed  to  apply 
them.  The  Part  Stress  Analysis  requires  the  greatest  amount  of  detail 
and  is  applicable  during  the  later  design  phase  where  actual  hardware 
and  circuits  are  being  designed.  The  Parts  Count  Method  requires  less 
information,  generally  that  dealing  with  quantity  of  different  part 
types,  quality  level  of  the  parts,  and  the  application  environment, 
lids  method  is  applicable  in  the  early  design  phase  and  during  bid 
proposal  formulation.  Both  methods  will  be  revised  periodically  and 
new  prediction  methods  will  be  added  as  they  are  developed.  The 
Appendices  contain  guidelines  for  system  and  equipment  reliability 
modeling  and  useful  approximations  for  reliability  calculations. 

The  failure  rates  presented  herein  represent  the  best  available 
knowledge  at  the  time  of  issue.  Reliability  predictions  performed  for 
military  agencies  should  use  no  other  source  of  data  unless  specifically 
approved  by  the  procuring  activity. 
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2.0  PART  STRESS  ANALYSIS  PREDICTION 
a.  Applicability. 

This  method  is  applicable  when  nest  of  the  design  is  completed  and  a 
detailed  parts  list  including  part  stresses  is  available.  It  can  also 
be  used  (hiring  later  design  phases  for  reliability  tradeoffs  vs.  part 
selection  and  stresses.  This  section  contains  failure  rate  models  for 
a broad  variety  of  parts  used  in  electronic  equipment.  The  parts  are 
grouped  by  major  categories  and,  where  appropriate,  are  sub-grouped 
within  categories.  The  major  categories  are  listed  in  Table  2-1. 

Table  2-1  MAJOR  PART  CATEGORIES  FOR  PART  STRESS  ANALYSIS 


PART  CATEGORY 

SECTION 

Microelectronics 

2.1 

Discrete  Semiconductors 

2.2 

Tubes 

2.3 

Lasers 

2.4 

Resistors 

2.5 

Capacitors 

2.6 

Inductive 

2.7 

Rotary 

2.8 

Relays 

2.9 

Switches 

2.10 

Connectors 

2.11 

Wire  £ Printed  Wire  Boards 

2.12 

Miscellaneous  (includes  connections) 

2.13 
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b.  Part  Quality. 

Tr.e  quality  of  a part  has  a direct  effect  on  the  part  failure  rate 
and  appears  in  the  part  models  as  a factor,  7tq.  ‘'any  parts  are 
covered  by  specifications  that  have  several  quality  levels,  hence 
the  part  re dels  have  values  of  7Tq  that  are  keyed  to  these  quality 
levels.  Such  parts  with  their  quality  designators  are  shown  in 
Table  2-2.  The  detailed  requirements  for  these  levels  are  clearly 
defined  in  the  applicable  specification. 


TABLE  2-2  PARTS  WITH  MULTI-LEVEL  QUALITY  SPECIFICATIONS 


Part 

Quality  Designators 

Microelectronic  s 

A,  B,  B-l,  B-2 , C 

Discrete  Semiconductors 

JANTXV,  JANTX,  JAN 

Capacitors,  Established  Reliability  (ER] 

L,  M,  P,  R,  S 

Resistors,  Established  Reliability  (ER) 

M,  P,  R,  S 

Sane  parts  are  covered  by  older  specifications,  usually  referred  to  as 
Non-ER,  that  do  not  have  multi-levels  of  quality.  These  part  models 
generally  have  three  quality  levels  designated  as  "Upper",  "Mil.  Spec.", 
and  "Lower".  If  the  part  is  procured  in  complete  accordance  with 
the  applicable  specification,  the  ttq  value  for  Mil.  Spec,  should  be 
used.  If  any  requirements  are  waived  or  if  a caimercial  part  is 
procured  the  value  for  Lower  should  be  used.  The  Upper  quality  level 
is  provided  because  better  than  Mil.  Spec,  quality  can  be  obtained;  however, 
the  use  of  the  Upper  irn  should  be  treated  with  caution ._  The  controls 
needed  to  produce  this 'level  vary  from  part  to  part  and"  even  within  part 
Sup-groups*.  The  additional  controls  needed  and  the  degree  to  which  Mil. 
Spec,  requirements  should  be  tightened  cannot  be  explicitly  defined 
because  of  the  wide  part  variety.  Considerable  engineering  judgment  is 
required  and  the  use  of  Upper  ttq  should  be  treated  on  an  individual  basis 
for  each  part.  To  aid  in  this  determination,  the  following  provides 
general  guidance  on  the  types  of  controls  needed: 

(1)  Dust  free  assembly  area  continuously  monitored  and  controlled. 

(2)  Tight  production  quality  control  from  raw  material  state  through 
acceptance,  implemented  by  detailed  written  procedures,  executed  by 
personnel  not  reporting  to  production  supervisor. 

(3)  Complete  manufacturing  drawing  system  with  change  procedures. 

(4)  Policy  of  assigning  personnel  with  proven  experience  in 
producing  parts  of  general  type. 
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(5)  Penalties  imposed  at  working  level  for  production  of 
unreported  defective  assemblies  (loss  of  incentive  pay,  etc.). 

(6)  Cleaning  stations  at  major  sub-assembly  points. 

(7)  FlexiHe  cleaning  procedure  to  compensate  for  contaminant 
variations. 

(8)  Daily  monitoring  of  contaminants. 

(9)  Mass  spectrometer  or  Radiflo  sealing  inspection  for 
hermetically  sealed  parts. 

(10)  Partial  re-qualification  testing  procedure  on  mximum 
semi-monthly  basis. 

(11)  Enforced  procedure  for  maintenance  of  quality  control  records 
and  for  modifying  production  and  inspection  as  needed  including  part 
failure  analysis. 

(12)  Reliability  screening. 

The  foregoing  discussion  involves  the"aS  procured"  part  quality.  Poor 
equipment  design,  production,  and  testing "facilities  can  degrade  part 
quality.  The  use  of  the  higher  quality  parts  requires  a total  equipment 
design  and  quality  control  process  coimensurate  with  the  high  part 
qualify.  It  would  jiake  little  sense  to  procure  high  quality  parts  only 
to  have  the  equipment  production  procedures  damage  the  parts  or  introduce 
latent  defects.  Total  equipment  program  descriptions  as  they  might  vary 
with  different  part  quality  mixes  is  beyond  the  scope  of  this  Handbook. 
Reliability  management  and  quality  control  procedures  are  described  in 
other  DOD  standards  and  publications.  Nevertheless,  when  a proposed 
equipment  development  is  pushing  the  state-of-the-art  and  has  a high 
reliability  requirement  necessitating  high  quality  parts,  the  total 
equipment  program  should  be  given  careful  scrutiny  and  not  just  the 
parts  quality.  Otherwise,  the  low  failure  rates  as  predicted  by  the 
models  for  high  quality  parts  will  not  be  valid. 

c.  Use  Environment . 

All  part  reliability  models  include  the  effects  of  environmental 
stresses  through  the  factor,  ir^..  The  definitions  of  these  environments 
are  shown  in  Table  2-3.  The  tij.  factor  is  quantified  within  each  part 
failure  rate  model.  These  environments  encompass  the  major  areas 
of  equipment  use.  Seme  equipment  my  experience  more  than  one 
environment  during  its  norml  use,  e.g. , equipment  in  spacecraft.  In 
such  a case,  the  reliability  analysis  should  be  segmented,  namely,  missile 
launch  (Ml)  conditions  during  boost  and  return  from  orbit,  and  space 
flight  (Sp)  while  in  orbit. 
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TABLE  2-3 

ENVIRONMENTAL  SYMBOL  IDENTIFICATION  AND  DESCRIPTION 


Environment 

Symbol 

Nominal  Environmental  Conditions 

Ground,  Benign 

gb 

Nearly  zero  environmental  stress  with  optimum 
engineering  operation  and  maintenance. 

Space,  Flight 

SF 

Earth  orbital.  Approaches  Ground,  Benign 
conditions  without  access  for  maintenance . 
Vehicle  neither  under  powered  flight  nor  in 
atmospheric  re-entry. 

Ground,  Fixed 

®F 

Conditions  less  than  ideal  to  include  install- 
ation in  permanent  racks  with  adequate  cooling 
air,  maintenance  by  military  personnel  and 
possible  installation  in  unheated  buildings. 

Ground,  Mobile 

Si 

Conditions  more  severe  than  those  for  G , 

(and  Portable) 

mostly  for  vibration  and  shock.  Cooling 
air  supply  may  also  be  more  limited,  and 
maintenance  less  uniform. 

Naval, 

NS 

Surface  ship  conditions  similar  to  Gp  but 
subject  to  occasional  high  shock  and1 vibration. 

Sheltered 

Naval,  Un- 

Sj 

Nominal  surface  shipbcme  conditions  but  with 

sheltered 

repetitive  high  levels  of  shock  and  vibration. 

Airborne, 

AI 

Typical  cockpit  conditions  without  environ- 

Inhabited 

mental  extremes  of  pressure , temperature , shock 
and  vibration. 

Airborne, 

Bomb-bay,  tail,  or  wing  installations  where 

Uninhabized 

extreme  pressure,  temperature,  and  vibration 
cycling  may  be  aggravated  by  contamination  frcm 
oil,  hydraulic  fluid,  and  engine  exhaust.  Classes 
I and  la  equipment  of  MIL-E-5-30  should  not  be 
used  in  this  environment. 

Missile, 

M. 

Severe  cond-’tiicns  of  noisp,  v:  hrwt-in^.,  o*th**r 

Launch 

L 

environments  related  to  missile  launch,  and 
space  vehicle  boost  into  orbit,  vehicle  re- 
entry and  landing  by  parachute.  Conditions  nay 
also  apply  to  installation  near  rain  rocket 
engines  during  launch  operations. 
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d.  Part  Failure  Rate  Models. 

Part  failure  rate  models  for  microelectronic  parts  are  significantly 
different  frcm  those  for  other  parts  and  are  presented  entirely  in 
Section  2.1.  Another  type  of  model  is  used  on  most  other  parts;  a 
typical  example  is  the  following  one  for  discrete  semiconductors: 


Xp  = x x tg2  x1tcx 

where  Ap  is  the  part  failure  rate, 

A,  is  the  base  failure  rate  usually  expressed  by  a model 
relating  the  influence  of  electrical  and  temperature 
stresses  on  the  part, 


itg  and  the  other  ir  factors  modify  the  base  failure  rate  for 
the  category  of  environmental  application  and  other 
parameters  that  affect  the  part  reliability. 


The  tv  and  tt-  factors  are  used  in  all  models  and  other  tt  factors  apply 
only  to  specific  models.  The  applicability  of  tt  factors  is  identified 
in  each  part  subsection.  An  overall  list  of  tt  factors  used  in  models 
other  than  microelectronics  is  presented  in  Table  2-4. 

The  base  failure  rate  (A.  ) models  are  presented  in  each  part  subsection 
along  with  identification  of  the  applicable  model  factors.  Tables  of 
calculated  A.  values  are  also  provided  for  use  in  manual  calculations. 
The  model  equations  can,  of  course,  be  incorporated  into  computer 
programs  for  nachine  processing.  The  tabulated  values  of  A^  are  cut 
off  at  the  part  ratings  with  regard  to  temperature  and  stress,  hence, 
use  of  parts  beyond  these  cut  off  points  will  overstress  the  part. 

The  use  of  the  Aw  models  in  a computer  program  should  take  the  part 
rating  limits  into  account.  The  A^  equations  are  mathematically 
continuous  beyond  the  part  ratings  but  such  failure  rate  values  are 
invalid  in  the  over-stressed  regions. 


All  the  part  models  include  both  catastrophic  and  drift  failures  and 
are  based  upon  a constant  failure,  except  for  some  rotary  devices  that 
show  an  increasing  failure  rate.  Failures  associated  with  connection 
of  parts  into  circuit  assemblies  are  not  included  within  the  part 
failure  rate  models.  Information  on  connection  reliability  is  provided 
in  Section  2.13. 


e.  Thermal  Aspects. 

The  use  of  this  prediction  method  requires  the  determination  of  the 
temperatures  surrounding  the  parts.  Since  parts  reliability  is  sensitive 
to  temperature,  the  thermal  analysis  of  any  design  should  fairly 
accurately  provide  the  ambient  temperatures  needed  in  using  the  part 
models.  Of  course,  lower  temperatures  produce  better  reliability  but 
also  can  produce  increased  penalties  in  terms  of  added  loads  on  the 
environmental  control  system.  The  thermal  analysis  should  be  part  of 
the  design  process  and  included  in  all  the  trade-off  studies  covering 

2-5 
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TABLE  2-4 


n FACTORS  FOR  PART  FAILURE  RATE  MODELS  EXCEPT  MICROELECTRONICS 


Factor 


n Factors  - 


ii^SSESE 


Description 


• categories. 


Environment  - Accounts  for  influence  of  environmental  factors 
other  than  temperature.  Related  to  application  categories 
(Table  2-3). 

Quality  - accounts  for  effects  of  different  quality  levels. 


Discrete  Semiconductors 


esistors 


Application  - Accounts  for  effect  of  application  in  terms 
of  circuit  function. 

Complexity  - Accounts  for  effect  of  multiple  devices  in  a 
single  package. 

Voltage  Stress  - Adjusts  model  for  a second  electrical 
stress  (application  voltage)  in  addition  to  wattage 
included  within  XK. 


Resistance  - Adjusts  model  for  the  effect  of  resistor  ohmic 
values . 

Construction  Class  - Accounts  for  influence  of  construction 
class  of  variable  resistors  as  defined  in  individual  part 
specif ications . 

Voltage  - Adjusts  for  effect  of  applied  voltage  in 
variable  resistors  in  addition  to  wattage  included  within 
X . 
b 

Tap  Connections  on  Potentiometers  - Accounts  for  effect 


TAP9  — c . . — - - *■ 

of  multiple  taps  on  resistance  element. 


citors 


Series  Resistance  - Adjusts  model  for  the  effect  of  series 
resistance  in  circuit  application  of  seme  electrolytic 
capacitors. 

Capacitance  Value  - Adjusts  model  for  effect  of  capacitance 
related  to  case  size. 


ductive  Devices 


Family  - adjusts  model  ror  influence  of  family  type  as 
defined  by  individual  part  specifications. 
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TABLE  2-4  (Cont.) 

it  FACTORS  FOR  PART  FAILURE  RATE  MODELS  EXCEPT  MICROELECTRONICS 


equipment  performance,  reliability,  weight,  volume,  environmental 
control  requirements,  etc.  For  general  guidance  and  detailed  thermal 
analysis  procedures,  refer  to  "Reliability/Design  Handbook,  Thermal 
Applications",  NAVELEX  Publication  No.  0967-437-7010,  July  1973. 
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CAUTION 

THE  FAILURE  RATES  PRESENTED  APPLY  TO  EQUIPMENT 
UNDER  NORMAL  OPERATING  CONDITIONS,  i.e.,  WITH 
POWER  ON  AND  PERFORMING  ITS  INTENDED  FUNCTIONS 
IN  ITS  INTENDED  ENVIRONMENT.  EXTRAPOLATION  OF 
ANY  OF  THE  BASE  FAILURE  RATE  MODELS  BEYOND  THE 
TABULATED  VALUES,  SUCH  AS  HIGfi  OR  SUB-ZERO 
TEMPERATURE,  OR  ELECTRICAL  STRESS  VALUES  ABOVE 
1.0  OR  AT  0 OR  EXTRAPOLATION  OF  ANY  ASSOCIATED 


MODIFIERS  IS  COMPLETELY  INVALID. 
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2.1  MICROELECTRONIC  DEVICES. 


This  section  presents  failure  rate  prediction  models  for  five  major 
classes  of  microelectronic  devices: 

Monolithic  Bipolar  6 MOS  Digital  (SSI/MSI) Sect.  2.1.1 

Monolithic  Bipolar  6 MOS  Linear Sect.  2.1.2 

Monolithic  Bipolar  6 MOS  Digital  (LSI) Sect.  2.1.3 

Monolithic  Bipolar  S MOS  Memories Sect.  2.1.4 

Hybrids Sect.  2.1.7 

In  the  title  description  of  each  monolithic  device  type,  SSI,  MSI, 
and  LSI  represent  Snail  Scale  Integration,  Medium  Scale  Integration, 
and  Large  Scale  Integration  respectively,  and  indicate  the  complexity 
level  for  which  the  device  model  is  applicable.  MOS  represents  all 
metal-oxide  semiconductor  microcircuits  which  includes  NMOS,  FMOS, 

CMOS,  and  MNOS  fabricated  on  various  substrates,  such  as  sapphire, 
polycrystalline,  or  single  crystal  silicon.  From  the  I.C.  chip 
standpoint,  the  hybrid  model  is  structured  to  accomodate  all  of 
the  monolithic  chip  types  and  the  various  complexity  levels 
indicated. 

Since  different  models  are  designated  for  the  SSI/MSI  and  LSI  Monolithic 
Digital  devices,  the  following  distinction  in  terms  of  complexity 
level  is  made  in  order  to  provide  guidance  in  selection  of  the 
appropriate  model.  For  the  present,  and  until  a new  limit  is 
established,  devices  having  complexities  less  than  100  gates 
(approximately  400  transistors)  are  to  be  considered  as  SSI/MSI 
devices.  More  complex  devices  by  gate  count  (or  transistor  count 
at  4 per  gate)  are  to  be  considered  as  LSI  devices.  No  distinction  is 
made  between  SSI  and  MSI  Monolithic  Digital  devices  since  the  same 
model  applies  directly  to  both.  Also,  no  distinction  is  rade  between 
the  complexity  factors  for  MOS  and  Bipolar  devices  in  that  the  factors 
that  define  complexity  are  independent  of  the  specific  technologies. 

For  the  purposes  of  this  handbook,  a gate  is  considered  to  be  any  one 
of  the  following  logic  functions:  AND,  OR,  NAND,  NOR,  Exclusive  OR, 
and  Inverter.  A J-K  or  R-S  flip-flop  is  equivalent  to  8 gates  when 
used  as  part  of  a couplex  circuit.  When  the  flip-flop  is  individually 
packaged  (single,  dual,  or  greater)  the  gate  count  should  be  deter- 
mined from  the  schematic  or  logic  diagram.  For  guidance  in  symbols  used 
for  these  functions,  see  Standard  ANSI  Y32. 14-1973,  "Graphic  Symbols  for 
Logic  Diagrams".  This  standard  has  been  adopted  by  the  Department 
of  Defense  and  supersedes  Mil-Std-806B  (an  earlier  logic  symbol 
standard). 

Monolithic  memories,  because  of  their  high  gate-to-pin  ratio,  are  not 
treated  as  a part  of  the  SSI/MSI/LSI  models.  Their  complexity 
factors  are  expressed  in  terns  of  the  number  of  bits  and  are  divided 
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into  the  two  major  categories -of  monolithic  memories:  random-access 
memories  (RAMS),  and  read-only  memories  (ROMS).  However,  for  the 
purposes  of  this  handbook,  progrannable-read-only  memories  (PROMS) 
and  content-addressable  memories  (CAMS)  are  considered  in  the  same 
categories  as  ROMS  and  RAMS,  respectively;  therefore,  the  same  no  sals 
are  applicable.  For  complex  (larger  than  dual  8-bit)  static  anc 
dynamic  shift  registers,  use  the  RAM  model  with  bit  count.  For 
smaller  shift  registers,  use  the  Digital  SSI/MSI  model.  For  linear 
devices,  both  MOS  and  Bipolar,  the  same  model  expressing  complexity 
in  terms  of  the  number  of  transistors  is  presented. 

In  order  to  help  clarify  some  of  the  parameter  descriptions  for  the 
various  models , all  of  monolithic  device  models  are  based  on  a 
+ X^  additive  model  concept"  — i.e.  Xp=  X^  + X^  where: 

X is  the  overall  device  failure  rate  for  monolithic  devices . 

P 


Xp  is  the  failure  rate  component  due  to  time  degradation  causes, 
and  represents  degradation  mechanisms  which  are  accelerated 
by  temperature  and  electrical  bias;  composed  largely  of 
phenomena  which  follow  the  Arrhenius  type  rate  acceleration. 

X^  is  the  failure  rate  component  due  to  mechanical  (application 
environment)  causes,  and  represents  failure  mechanisms 
resulting  from  mechanical  stresses  directly,  or  indirectly 
(such  as  stresses  set  up  by  thermal  expansion). 

The  monolithic  device  models,  along  with, 
parameter  descriptions  and  instructions  for  quantifying  the  parameters 
are  presented  in  sections  2.1.1  through  2.1.4.  The  tables  used  •for 
quantifying  the  model  parameters  are  presented  in  section  2.1.5. 
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2.1.1  MONOLITHIC  BIPOLAR  AND  MOS  DIGITAL  SSI/MSI  DEVICES 
(less  than  100  gates  or  400  transistors). 

Xp  * *q  (Cx  H,p  + Cj  Wj?) 


where: 

g 

Xp  is  the  device  failure  rate  in  F./10  Hours 

ir  is  the  device  learning  factor  and  its  value  is  determined 
L from  Table  2. 1.5-2. 


7Tq  is  the  quality  factor.  Table  2.1. 5-1. 

u is  the  temperature  acceleration  factor  and  its  values, 

T depending  upon  the  device  technology,  are  determined  from 
Table  2.1. 5-4. 

irE  is  the  application  environment  multiplier  and  its  values 
are  determined  from  Table  2. 1.5-3. 

Cp  C2  are  the  circuit  complexity  factors  and  are  equal  to: 

C2  = .00129  (G)(0,67) 

C2  * .00389  (G)(0’35) 

where  G is  the  number  of  gates  (assume  4 transistors  per  gate). 
The  C values  are  found  in  Table  2. 1.5-5. 
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2.1.2  MONOLITHIC  BIPOLAR  AND  MOS  LINEAR  DEVICES. 

*P  = \ *Q  (C1  *T2  + C2  V 
where: 

0 

Xp  is  the  device  failure  rate  in  F./10  Hours 
7Tq  is  quality  factor.  Table  2. 1.5-1 

ir.  is  the  device  learning  factor  and  its  value  is  determined 
u from  Table  2.1. 5-2. 

7r^2  is  the  temperature  acceleration  factor  and  its  values  are 
* determined  from  Figure  2. 1.5-4. 

ir_  is  the  application  environment  multiplier  and  its  values 
L are  determined  from  Table  2. 1.5-3. 

Cj,  C2  are  the  circuit  complexity  factors  and  are  equal  to: 

C,  = .00056  (T)  0,76 
C2  = .0026  (T)  0,55 

where:  T is  the  number  of  transistors.  These  C values  are 
found  in  Table  2. 1.5-6. 
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2.1.3  MONOLITHIC  BIPOLAR  AND  MOS  DIGITAL  LSI  DEVICES  (equal  tt 
greater  than  100  gates  or  400  transistors). 


) 


XP  = \ \ <C1  \ * C2  *E 

where: 

Xp  is  the  device  failure  rate  in  F./10®  Hours 

nL  is  the  device  learning  factor  and  its  value  is  deternir.ee 
from  Table  2.1. 5-2 

i.  is  the  temperature  acceleration  factor  and  its  values,  depend!: 
upon  the  device  technology,  are  found  in  Table  2.1.5 — 

tTq  is  the  quality  factor.  Table  2. 1.5-1 

itp  is  the  application  environment  multiplier  and  its  values 
are  determined  frem  Table  2.1. 5-3 

C^,  are  the  circuit  complexity  factors  and  are  equal  tc : 


<1 


= .0187  e 


C2  = .013  e 


(0.005G) 

(G.004G) 


Where:  G is  the  number  of  gates  (assume  4 transistors  pan  gate) 

and  e is  the  natural  logarithm  base,  2.718.  The  C values  are 
found  in  Table  2. 1.5-7. 
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2.1.4  MONOLITHIC  MOS  AND  BIPOLAR  MEMORIES. 

Xp  = UL  4 ^2  *E^ 

where:  Xp  is  the  device  failure  rate  in  F./106  hours 

is  the  device  learning  factor  and  its  value  is  determined 
frcm  Table  2. 1.5-2. 

7Tq  is  the  quality  factor.  Table  2.1. 5-1. 

TT,p  is  the  temperature  acceleration  factor  and  its  values, 

1 depending  upon  the  device  technology,  are  determined  from 
Table  2.1. 5-4. 

TTp  is  the  application  environment  multiplier  and  its  values 
are  determined  from  Table  2.1. 5-3. 

C1,  C2  are  the  circuit  complexity  factors  and  are: 

For  RAMS 

C-l  = .00199  B (0,603) 

C2  =.00056  B (0'644) 

For  ROMS 

Cx  = .00114  B (0,603) 

C2  = .00032  B (0,o46) 

Where  B is  the  number  of  bits.  These  C values  are  found  in 
Table  2.1. 5-8. 
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2.1.5  FIGURES  AND  TABLES  FOR  TOE  MONOLITHIC  MODEL  PARAMETERS 

This  section  presents  the  tables  and  figures  for  quantifying  the  parameters 
of  the  failure  rate  models  in  sections  2.1.1  through  2.1.4  for  the  various 
monolithic  microelectronic  device  types.  The  tables  are  presented  first, 
and  then  the  figures. 

TABLE  2. 1.5-1 


tTq,  QUALITY  FACTORS 


Quality  Level 
or  Screen  Class 

Description 

*Q 

A 

Mil-M-38510,  Class  A (JAN) 

1 

B 

Mil-M-38510,  Class  B (JAN) 

2 

B-l 

Mil-Std-883,  Method  5004,  Class  B 

5 

B-2 

Vendor  Equivalent  of  Mil-Std-883, 
Method  5004,  Class  B 

10 

C 

Mil-M-38510,  Class  C (JAN) 

16 

D 

Ccrmercial  (or  non-mil  standard)  part, 
with  no  screening  beyond  the  manufact- 
urer's regular  quality  assurance 
practices.  The  indicated  7Tq  value 
represents  an  average  for  all  grades 
of  caimercial  parts. 

150 

TABLE  2.1. 5-2 
irL,  LEARNING  FACTORS 


The  learning  factor  rrL  is  10  under  any  of  the  following  conditio: 

(1)  New  device  in  initial  production. 

(2)  Where  najor  changes  in  design  or  process  have  occurred. 

(3)  Where  there  has  been  an  extended  interruption  in  production 
or  a change  in  line  personnel  (radical  expansion). 


Tr.~  f-  tor  c f IT  car  be  expected  to  apply  until  conditions  and  ccr.tr:  1 
x:  rtalilized.  T:_i:  period  can  extend  fcr  as  much  as  six  month?  c* 
tor.tir.uous  production. 

t.  is  equal  to  1.0  under  all  production  conditions  not  stated  in 
(1),  (?)  and  (3)  above. 
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TABLE  2.1. 5-4 

uT  vs.  JUNCTION  TEMPERATURE  (See  Notes  below) 


NOTES: 


ir  is  applicable  to  Bipolar  digital  devices,  i.e.,  TTL  6 DTL, 
11  not  included  in  Note  2 below. 

ir  = O.le  x 

n 


( 1 1 \ 
where:  x = -4794  [Tj+273  " 298/ 


Tf  is  applicable  to  Bipolar  £ MOS  Linear,  Bipolar  Beam  Lead, 
T2  Bipolar  ECL,  and  all  other  MOS  devices. 


irT2  = 0.1  e * 
where  x = -8121 


'777  ~ 


3.  In  Notes  1 £ 2 above,  T.  is  worst  case  junction  temperature 
(°C.)  and  e is  natural  logarithm  base,  2.718. 

If  T j is  unknown,  use  following  approximations: 

For  packaged  monolithic  devices  use 

Tj  = ambient  T + 10°C.  if  no.  of  transistors  < 120. 

Tj  - ambient  T + 25°C.  if  no.  of  transistors  > 120. 
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TABU)  2.1. 5-5 

Cx6  C2,  COMPLEXITY  FACTORS  FOR  SSI/MSI  DEVICES  (See  Notes  below) 


TSd7“ 

2ATES 

m 

jljgn 

na 

raa 

19 

a 

U3m 

a 

1 

.0013  .0033 

24 

.011  .012 

48 

.018 

.016 

72 

.023 

.018 

2 

.0021  .0050 

26 

.012  .013 

50 

.018 

.016 

74 

.024 

.018 

4 

.0033  .0064 

28 

.012  .013 

52 

.019 

.016 

76 

.024 

.019 

6 

.0043  .0074 

30 

.013  .013 

54 

.019 

.016 

78 

.025 

.019 

6 

.0053  *0082 

32 

.014  .014 

56 

.020 

.017 

80 

.025 

.019 

10 

.0061  .0089 

34 

.014  .014 

58 

.020 

.017 

85 

.026 

.019 

12 

.0069  .0095 

36 

.015  .014 

60 

.021 

.017 

90 

.027 

.020 

14 

.0077  .010 

38 

.015  .014 

62 

.021 

.017 

95 

.028 

.020 

16 

.0084  .011 

40 

.016  .015 

64 

.022 

.017 

99 

.029 

.020 

18 

.0091  .oil 

42 

.016  .015 

66 

.022 

.018 

20 

.0098  .011 

44 

.017  .015 

68 

.022 

.018 

22 

.011  .012 

46 

.017  .015 

70 

.023 

.018 

NOTES: 


1.  Tabulated  values  are  derived  from  the  following  equations: 
C1  = 1. 29 (10)~ 3 (Nq>0  * 677  C2  = 3.89(10)"3(Ng)0'359 

where  Nq  = no.  of  gates  (assume  4 transistors/gate) . 

2.  The  tabulated  values  are  applicable  to  devices  in  packages 
containing  up  to  22  pins.  For  larger  packages  multiply 
the  values  by: 


No.  of  Pins 
24  to  40 
42  to  64 
>64 


Multiplier 

1.1 

1.2 

1.3 
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TABLE  2.1. 5-6 

C fc  C . CGMPLEXm-  FACTORS  FOR  LINEAR  DEVICES  (See  Note  below) 

1 2 
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TABLE  2.1. 5-7 

C1  6 C2,  COMPLEXITY  FACTORS  FOR  LSI  DEVICES  (See  Notes  below) 


wmm 

mam 

mm 

MM 

WM 

Ksfl 

■W 

mm 

MM 

■9 

MB 

MB 

19 

M 

MB 

msm 

.030 

Klfl 

.088 

.053 

610 

.33 

.17 

890 

1.2 

no 

.031 

.021 

350 

.097 

.057 

630 

.36 

.19 

910 

1.4 

.62 

120 

.033 

.022 

370 

.11 

.062 

650 

.40 

.20 

930 

1.5 

.67 

. 130 

.034 

.023 

390 

.12 

.068 

670 

.44 

.22 

950 

1.6 

.73 

140 

.036 

.024 

410 

.13 

.074 

690 

.48 

.24 

970 

1.8 

.79 

150 

.038 

.025 

430 

.14 

.080 

710 

.53 

.26 

990 

2.0 

.86 

170 

.042 

.028 

450 

.16 

.086 

730 

.58 

.29 

1010 

2.2 

.94 

190 

.046 

.029 

470 

.17 

.095 

750 

.64 

.31 

1050 

2.6 

1.1 

210 

.050 

.032 

490 

.19 

.10 

770 

.70 

.34 

1100 

3.3 

1.4 

230 

.055 

.034 

510 

.21 

.n 

790 

.77 

.37 

1150 

4.2 

1.7 

250 

.061 

.038 

530 

.23 

.12 

810 

.85 

.40 

1200 

5.3 

2.1 

270 

.067 

.041 

550 

.25 

.13 

830 

.93 

.44 

1250 

6.7 

2.6 

290 

.073 

.044 

570 

.27 

.15 

850 

1.0 

.48 

1300 

8.5 

3.2 

310 

.080 

.048 

590 

.30 

.16 

870 

1.1 

.52 

NOTES: 

1.  Tabulated  values  are  derived  frc n the  following  equations: 

(.00423)  Ng 


C„  = .013  e 

L 


Cl  = .0187  e 

where  N„  = no.  of  gates  (assure  4 transistors/gate) 

and  e = natural  logarithm  base,  2.718. 

The  tabulated  values  are  applicable  to  devices  in  packages 
containing  up  to  24  pins.  For  larger  packages , multiply  values  by: 


No.  of  Pins 

26  to  64 
>64 


Multiplier 

1.1 

1.2 


2.1.  5-6 


FA-25 


NOTES 

1.  Tabulated  values  are  derived  from  the  following  equations: 

For  ROMS  - = .00114(B)0,603  C2  = .00032(B)0,646 

For  RAMS  - = .00199(B)0,603  = .00056(B)0,644 

where:  B = number  of  bits. 

2.  The  tabulated  values  are  applicable  to  devices  in  packages 
containing  up  to  24  pins.  For  packages  with  greater  than  24  pins, 
multiply  tabulated  value  by  1.1. 


TABLE  2.1. 5-8 

C^ECj,  COMPLEXITY  FACTORS  FOR  MEMORIES  (See  Notes  below) 


ROMS 

RAMS 

No.  of 

C 

C 

C 

C 

BITS 

1 

2 

1 

2 

16 

.0061 

.0019 

.011 

.0033 

32 

.0092 

.0030 

.016 

.0052 

64 

.014 

.0047 

.025 

.0081 

128 

.021 

.0074 

.037 

.013 

256 

.032 

.012 

.056 

.020 

320 

.037 

.013 

.065 

.023 

512 

.049 

.018 

.086 

.031 

576 

.053 

.020 

.092 

.034 

1024 

.074 

.028 

.13 

.049 

1120 

.078 

.030 

.14 

.052 

1280 

.085 

.033 

.15 

.056 

2048 

.11 

.044 

.20 

.076 

2240 

.12 

.047 

.21 

.081 

2560 

.13 

.051 

.23 

.083 

4096 

.17 

.070 

.30 

.12 

8192 

.26 

.11 

.46 

.19 

9216 

.28 

.12 

.49 

.20 

10240 

.30 

.13 

.52 

.22 

12288 

.33 

.14 

.58 

.24 

14848 

.37 

.16 

.65 

.27 

16384 

.40 

.17 

.69 

.29 

ft  i 
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APPENDIX  B (TO  TR  2020  APPENDIX  F): 
EXCERPTS  FROM  RCA  WARRANTIES 


IVM-2 

8/30/76 

TERMS  AND  CONDITIONS  OF  SALE 

Applicable  to  the  Sale  of  Closed  Circuit  Video  Equipment  such  as  Television  Cameras,  Monitors,  and  Accessories. 


7.  OTHER  WARRANTIES 

(a)  RCA  warrants  its  products  against  defects  in  material  or 
workmanship  for  the  periods  specified  in  the  adjustment  terms 
set  forth  on  the  applicable  Price  Schedule,  (b)  Said  warranty  does 
not  apply  if  product  malfunction  is  the  result  of  misuse,  abuse, 
improper  installation  or  application,  alteration,  accident,  or  negli- 
gence in  use,  storage,  transportation  or  handling,  or  if  the  original 
identification  markings  on  the  product  have  been  removed,  defaced 
or  altered,  (c)  In  order  to  permit  RCA  to  properly  administer 
this  warranty,  the  Customer  shall  i)  notify  RCA  promptly  in 
writing  of  any  claims,  and  ii)  provide  RCA  with  the  opportunity 
to  inspect  and  test  the  product  claimed  to  be  defective.  Such 
inspection  may  be  on  the  Customer’s  premises  and/or  RCA 
may  request  the  return  of  the  product,  transportation  charges 
prepaid,  for  more  thorough  examination.  However,  RCA  cannot  be 
responsible  for  packing,  inspection,  or  labor  costs  in  connection  with 
the  return  of  product.  In  order  to  avoid  administrative  difficulties 
that  result  from  unauthorized  returns,  'he  Customer  shall  request  a 
formal  Return  Authorization  from  RCA  before  returning  product  for 
any  reason,  (d)  The  liability  of  RCA  hereunder  is  solely  and  ex- 
clusively limited  to  replacement,  repair  or  credit  at  the  price  on  the 
date  of  claim  at  RCA’s  option,  for  any  product  which  is  returned  by 
the  Customer  during  the  applicable  warranty  period  and  which  is 
found  by  RCA  to  be  subject  to  adjustment  under  this  warranty.  In  no 
event  shall  RCA  be  liable  for  special,  indirect,  incidental  or  conse- 
quential damages  whether  in  contract,  tort  or  negligence,  (c)  This 
warranty  extends  only  to  Customers  of  RCA  and  not  to  purchasers 
or  users  of  said  Customer’s  products. 

RCA  MARKS  NO  OTHER  OR  FURTHER  WARRANTY,  EXPRESS 
OR  IMPLIED,  INCLUDING  ANY  WARRANTY  OF  FITNESS  FOR 
A PARTICULAR  PURPOSE  OR  WARRANTY  OF  MERCHANT- 
ABILITY. 


’Copyright  1976  RCA.  Reprinted  with  permission. 
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It  is  recognized  that  some  purchasers  of  the  TCI150  and  TCI  155  may  wish  to  eval- 
uate the  state-of-the-art  technology  of  RCA  SIDs,  and  some  may  even  wish  to  explore 
alternate  operating  modes.  A complete  schematic  drawing  and  functional  block  diagram 
has  been  shipped  with  your  camera  which,  when  taken  in  conjunction  with  the  camera  data 
sheet  and  the  SID51232  sensor  data  sheet,  should  facilitate  a more  complete  understanding 
of  this  new  method  of  television  image  sensing.  HOWEVER,  IT  SHOULD  BE  NOTED 
THAT  RCA  CANNOT  BE  RESPONSIBLE  FOR  ANY  CAMERA  WHICH  HAS  BEEN 
TAMPERED  WITH  INTERNALLY  OR  MODIFIED  IN  ANY  WAY. 


LIMITED  WARRANTY* 

RCA  warrants  the  camera  when  purchased  new  to  be  free  from  defects  in 
material  and  workmanship  and  will  repair  or  replace,  at  RCA’s  option, 
any  camera  which  under  the  proper  conditions  of  installation  and  use 
exhibits  such  defects,  provided  that  the  product  is  returned  properly 
packed,  transportation  prepaid  under  the  proper  Return  Authorization 
paperwork  (obtained  from  your  local  RCA  Technical  Sales  Representative) 
to:  RCA  Camera  Repair  Center,  New  Holland  Avenue,  Lancaster,  Pa. 

1 7604. 

Full  adjustment  will  be  made  for  the  camera  or  any  part  thereof  (including 
the  SID51232  sensor)  found  to  be  defective  upon  inspection  or  test, 
provided  that  the  claim  is  made  within  90  days  from  the  date  of  shipment 
from  RCA. 

In  no  event  shall  RCA  be  liable  for  special,  indirect,  incidental  or  conse- 
quential damages,  the  original  user’s  remedies  being  limited  to  repair  or 
replacement. 

RCA  MAKES  NO  OTHER  OR  FURTHER  WARRANTY,  EXPRESS  OR 
IMPLIED,  INCLUDING  ANY  WARRANTY  OF  FITNESS  FOR  A PAR- 
TICULAR PURPOSE  OR  WARRANTY  OF  MERCHANTABILITY. 


•Copyright  1974  RCA.  Reprinted  with  permission. 
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FAIRCHILD  CHARGE  COUPLED  DEVICE  • CCD121 


CLOCK  CHARACTERISTICS:  TA  = 25°C 


V01AL'  Vi>lBL 
V02AL'  V02BL 


V4>XAL 


VOXAH 


PARAMETER 


Analog  Shift  Register 
Transport  Clocks  LOW 


Analog  Shift  Register 
Transport  Clocks  HIGH 


Transfer  Gate  Clock  LOW 


Transfer  Gate  Clock  HIGH 


Reset  Clock  Low 


Reset  Clock  HIGH 


Analog  Shift  Register 
Transport  Clock  Frequency 


Reset  Clock  Frequency 
(Output  Bit  Rate) 


RANGE 

MIN  I TYP  I MAX  UNITS 


0.0  0.5  0.8 


10 


CONDITIONS 


Notes  3,  4 


Notes  3,4 


Notes  3, 4,  12 


Notes  3, 4 


MHz 

Notes  5,  6 

MHz 

Notes  5,  6 

AC  CHARACTERISTICS:  TA  = 25°C,  f0)  = f02  = 0.5  MHz,  f^R  = I MHz,  t,NT  = 1.94  ms,  tTRANSFER  = 1.73  ms 


PARAMETER 


Dynamic  Range 


Peak-to-Peak  Equivalent  Exposure 


Saturation  Exposure 


Spectral  Response  Range  Limits 


Responsivity 


Photoresponse  Non-uniformity 


Average  Dark  Signal 


Dark  Signal  Non-uniformity 


Saturation  Output  Voltage 


Power  Dissipation 


Output  Impedance 


Peak-to-Peak  Noise 


Rate  of  Average  Signal  Offset 


CONDITIONS 


Notes,  7,  8,  9 


Notes  8,  9 


Notes  8,  9 


DC  CHARACTERISTICS:  TA  = 25°  C 


RANGE 

SYMBOL 

PARAMETER 

MIN 

TYP 

MAX 

VOD 

Output  Transistor  Drain  Voltage 

14.5 

15.0 

15.5 

VRD 

Reset  Transistor  Drain  Voltage 

14.5 

15.0 

15.5 

Output  Gate  Voltage 


VPG  Photogate  Voltage 


TP1  TP3  Test  Points 


TP2  TP4  | Test  Points 


CONDITIONS 


